Jul 31 12:06:36 user nova-compute[72447]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 31 12:06:39 user nova-compute[72447]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72447) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72447) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72447) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 31 12:06:39 user nova-compute[72447]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:06:39 user nova-compute[72447]: INFO nova.virt.driver [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 31 12:06:39 user nova-compute[72447]: INFO nova.compute.provider_config [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] Acquiring lock "singleton_lock" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] Acquired lock "singleton_lock" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] Releasing lock "singleton_lock" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] Full set of CONF: {{(pid=72447) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ******************************************************************************** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] Configuration options gathered from: {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ================================================================================ {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] allow_resize_to_same_host      = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] arq_binding_timeout            = 300 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] backdoor_port                  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] backdoor_socket                = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] block_device_allocate_retries  = 300 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] block_device_allocate_retries_interval = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cert                           = self.pem {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute_monitors               = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] config_dir                     = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] config_drive_format            = iso9660 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] config_source                  = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] console_host                   = user {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] control_exchange               = nova {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cpu_allocation_ratio           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] daemon                         = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] debug                          = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] default_access_ip_network_name = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] default_availability_zone      = nova {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] default_ephemeral_format       = ext4 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] default_schedule_zone          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] disk_allocation_ratio          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] enable_new_services            = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] enabled_ssl_apis               = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] flat_injected                  = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] force_config_drive             = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] force_raw_images               = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] graceful_shutdown_timeout      = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] heal_instance_info_cache_interval = 60 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] host                           = user {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] instance_build_timeout         = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] instance_delete_interval       = 300 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] instance_name_template         = instance-%08x {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] instance_usage_audit           = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] instance_usage_audit_period    = month {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] internal_service_availability_zone = internal {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] key                            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] live_migration_retry_count     = 30 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] log_config_append              = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] log_dir                        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] log_file                       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] log_options                    = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] log_rotate_interval            = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] log_rotate_interval_type       = days {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] log_rotation_type              = none {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] long_rpc_timeout               = 1800 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] max_concurrent_builds          = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] max_concurrent_live_migrations = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] max_concurrent_snapshots       = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] max_local_block_devices        = 3 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] max_logfile_count              = 30 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] max_logfile_size_mb            = 200 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] maximum_instance_delete_attempts = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] metadata_listen                = 0.0.0.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] metadata_listen_port           = 8775 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] metadata_workers               = 3 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] migrate_max_retries            = -1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] mkisofs_cmd                    = genisoimage {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] my_ip                          = 10.0.0.210 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] network_allocate_retries       = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] osapi_compute_listen_port      = 8774 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] osapi_compute_unique_server_name_scope =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] osapi_compute_workers          = 3 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] password_length                = 12 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] periodic_enable                = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] periodic_fuzzy_delay           = 60 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] pointer_model                  = ps2mouse {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] preallocate_images             = none {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] publish_errors                 = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] pybasedir                      = /opt/stack/nova {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ram_allocation_ratio           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] rate_limit_burst               = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] rate_limit_except_level        = CRITICAL {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] rate_limit_interval            = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] reboot_timeout                 = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] reclaim_instance_interval      = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] record                         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] reimage_timeout_per_gb         = 60 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] report_interval                = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] rescue_timeout                 = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] reserved_host_cpus             = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] reserved_host_disk_mb          = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] reserved_host_memory_mb        = 512 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] reserved_huge_pages            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] resize_confirm_window          = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] resize_fs_using_block_device   = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] resume_guests_state_on_host_boot = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] rpc_response_timeout           = 60 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] run_external_periodic_tasks    = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] running_deleted_instance_action = reap {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] running_deleted_instance_timeout = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] scheduler_instance_sync_interval = 120 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] service_down_time              = 60 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] servicegroup_driver            = db {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] shelved_offload_time           = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] shelved_poll_interval          = 3600 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] shutdown_timeout               = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] source_is_ipv6                 = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ssl_only                       = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] state_path                     = /opt/stack/data/nova {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] sync_power_state_interval      = 600 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] sync_power_state_pool_size     = 1000 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] syslog_log_facility            = LOG_USER {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] tempdir                        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] timeout_nbd                    = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] transport_url                  = **** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] update_resources_interval      = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] use_cow_images                 = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] use_eventlog                   = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] use_journal                    = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] use_json                       = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] use_rootwrap_daemon            = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] use_stderr                     = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] use_syslog                     = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vcpu_pin_set                   = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plugging_is_fatal          = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plugging_timeout           = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] virt_mkfs                      = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] volume_usage_poll_interval     = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] watch_log_file                 = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] web                            = /usr/share/spice-html5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_concurrency.disable_process_locking = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.auth_strategy              = keystone {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.compute_link_prefix        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.dhcp_domain                = novalocal {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.enable_instance_password   = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.glance_link_prefix         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.instance_list_per_project_cells = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.list_records_by_skipping_down_cells = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.local_metadata_per_cell    = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.max_limit                  = 1000 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.metadata_cache_expiration  = 15 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.neutron_default_tenant_id  = default {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.use_forwarded_for          = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.use_neutron_default_nets   = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.vendordata_dynamic_targets = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.vendordata_jsonfile_path   = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.backend_argument         = **** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.config_prefix            = cache.oslo {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.dead_timeout             = 60.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.debug_cache_backend      = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.enable_retry_client      = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.enable_socket_keepalive  = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.enabled                  = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.expiration_time          = 600 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.hashclient_retry_attempts = 2 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.memcache_dead_retry      = 300 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.memcache_password        =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.memcache_sasl_enabled    = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.memcache_username        =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.proxies                  = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.retry_attempts           = 2 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.retry_delay              = 0.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.socket_keepalive_count   = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.socket_keepalive_idle    = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.socket_keepalive_interval = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.tls_allowed_ciphers      = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.tls_cafile               = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.tls_certfile             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.tls_enabled              = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cache.tls_keyfile              = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.auth_section            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.auth_type               = password {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.cafile                  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.certfile                = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.collect_timing          = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.cross_az_attach         = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.debug                   = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.endpoint_template       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.http_retries            = 3 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.insecure                = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.keyfile                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.os_region_name          = RegionOne {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.split_loggers           = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cinder.timeout                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute.cpu_dedicated_set      = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute.cpu_shared_set         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute.image_type_exclude_list = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute.resource_provider_association_refresh = 300 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute.shutdown_retry_interval = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] conductor.workers              = 3 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] console.allowed_origins        = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] console.ssl_ciphers            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] console.ssl_minimum_version    = default {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] consoleauth.token_ttl          = 600 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.cafile                  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.certfile                = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.collect_timing          = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.connect_retries         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.connect_retry_delay     = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.endpoint_override       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.insecure                = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.keyfile                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.max_version             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.min_version             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.region_name             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.service_name            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.service_type            = accelerator {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.split_loggers           = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.status_code_retries     = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.status_code_retry_delay = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.timeout                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] cyborg.version                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.backend               = sqlalchemy {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.connection            = **** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.connection_debug      = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.connection_parameters =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.connection_recycle_time = 3600 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.connection_trace      = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.db_inc_retry_interval = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.db_max_retries        = 20 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.db_max_retry_interval = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.db_retry_interval     = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.max_overflow          = 50 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.max_pool_size         = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.max_retries           = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.mysql_enable_ndb      = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.mysql_wsrep_sync_wait = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.pool_timeout          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.retry_interval        = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.slave_connection      = **** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] database.sqlite_synchronous    = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.backend           = sqlalchemy {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.connection        = **** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.connection_debug  = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.connection_parameters =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.connection_recycle_time = 3600 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.connection_trace  = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.db_inc_retry_interval = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.db_max_retries    = 20 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.db_max_retry_interval = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.db_retry_interval = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.max_overflow      = 50 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.max_pool_size     = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.max_retries       = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.mysql_enable_ndb  = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.pool_timeout      = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.retry_interval    = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.slave_connection  = **** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] api_database.sqlite_synchronous = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] devices.enabled_mdev_types     = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ephemeral_storage_encryption.enabled = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.api_servers             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.cafile                  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.certfile                = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.collect_timing          = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.connect_retries         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.connect_retry_delay     = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.debug                   = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.default_trusted_certificate_ids = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.enable_certificate_validation = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.enable_rbd_download     = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.endpoint_override       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.insecure                = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.keyfile                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.max_version             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.min_version             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.num_retries             = 3 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.rbd_ceph_conf           =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.rbd_connect_timeout     = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.rbd_pool                =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.rbd_user                =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.region_name             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.service_name            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.service_type            = image {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.split_loggers           = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.status_code_retries     = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.status_code_retry_delay = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.timeout                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.verify_glance_signatures = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] glance.version                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] guestfs.debug                  = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.config_drive_cdrom      = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.config_drive_inject_password = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.enable_remotefx         = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.instances_path_share    =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.limit_cpu_features      = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.use_multipath_io        = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.vswitch_name            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] mks.enabled                    = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] image_cache.manager_interval   = 2400 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] image_cache.precache_concurrency = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] image_cache.remove_unused_base_images = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] image_cache.subdirectory_name  = _base {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.api_max_retries         = 60 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.api_retry_interval      = 2 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.auth_section            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.auth_type               = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.cafile                  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.certfile                = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.collect_timing          = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.connect_retries         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.connect_retry_delay     = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.endpoint_override       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.insecure                = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.keyfile                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.max_version             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.min_version             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.partition_key           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.peer_list               = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.region_name             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.serial_console_state_timeout = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.service_name            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.service_type            = baremetal {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.split_loggers           = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.status_code_retries     = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.status_code_retry_delay = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.timeout                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ironic.version                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] key_manager.fixed_key          = **** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.barbican_api_version  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.barbican_endpoint     = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.barbican_endpoint_type = public {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.barbican_region_name  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.cafile                = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.certfile              = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.collect_timing        = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.insecure              = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.keyfile               = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.number_of_retries     = 60 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.retry_delay           = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.send_service_user_token = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.split_loggers         = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.timeout               = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.verify_ssl            = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican.verify_ssl_path       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican_service_user.auth_section = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican_service_user.auth_type = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican_service_user.cafile   = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican_service_user.certfile = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican_service_user.collect_timing = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican_service_user.insecure = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican_service_user.keyfile  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican_service_user.split_loggers = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] barbican_service_user.timeout  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.approle_role_id          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.approle_secret_id        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.cafile                   = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.certfile                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.collect_timing           = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.insecure                 = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.keyfile                  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.kv_mountpoint            = secret {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.kv_version               = 2 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.namespace                = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.root_token_id            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.split_loggers            = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.ssl_ca_crt_file          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.timeout                  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.use_ssl                  = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.cafile                = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.certfile              = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.collect_timing        = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.connect_retries       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.connect_retry_delay   = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.endpoint_override     = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.insecure              = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.keyfile               = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.max_version           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.min_version           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.region_name           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.service_name          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.service_type          = identity {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.split_loggers         = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.status_code_retries   = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.status_code_retry_delay = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.timeout               = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] keystone.version               = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.connection_uri         =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.cpu_mode               = custom {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: WARNING oslo_config.cfg [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.cpu_power_governor_high = performance {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.cpu_power_management   = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.device_detach_attempts = 8 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.device_detach_timeout  = 20 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.disk_cachemodes        = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.disk_prefix            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.enabled_perf_events    = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.file_backed_memory     = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.gid_maps               = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.hw_disk_discard        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.hw_machine_type        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.images_rbd_pool        = rbd {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.images_type            = default {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.images_volume_group    = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.inject_key             = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.inject_partition       = -2 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.inject_password        = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.iscsi_iface            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.iser_use_multipath     = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_downtime = 500 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_inbound_addr = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_scheme  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_timeout_action = abort {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_tunnelled = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: WARNING oslo_config.cfg [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 31 12:06:39 user nova-compute[72447]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 31 12:06:39 user nova-compute[72447]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 31 12:06:39 user nova-compute[72447]: and ``live_migration_inbound_addr`` respectively.
Jul 31 12:06:39 user nova-compute[72447]: ).  Its value may be silently ignored in the future.
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.live_migration_with_native_tls = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.max_queues             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.nfs_mount_options      = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.num_pcie_ports         = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.pmem_namespaces        = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.quobyte_client_cfg     = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.rbd_secret_uuid        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.rbd_user               = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.rescue_image_id        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.rescue_kernel_id       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.rx_queue_size          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.smbfs_mount_options    =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.snapshot_compression   = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.snapshot_image_format  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.sparse_logical_volumes = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.swtpm_enabled          = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.swtpm_group            = tss {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.swtpm_user             = tss {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.sysinfo_serial         = unique {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.tb_cache_size          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.tx_queue_size          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.uid_maps               = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.use_virtio_for_bridges = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.virt_type              = kvm {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.volume_clear           = zero {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.volume_clear_size      = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.volume_use_multipath   = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.vzstorage_cache_path   = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.auth_section           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.auth_type              = password {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.cafile                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.certfile               = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.collect_timing         = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.connect_retries        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.connect_retry_delay    = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.default_floating_pool  = public {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.endpoint_override      = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.extension_sync_interval = 600 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.http_retries           = 3 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.insecure               = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.keyfile                = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.max_version            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.min_version            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.ovs_bridge             = br-int {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.physnets               = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.region_name            = RegionOne {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.service_metadata_proxy = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.service_name           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.service_type           = network {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.split_loggers          = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.status_code_retries    = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.status_code_retry_delay = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.timeout                = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] neutron.version                = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] notifications.bdms_in_notifications = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] notifications.default_level    = INFO {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] notifications.notification_format = unversioned {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] notifications.notify_on_state_change = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] pci.alias                      = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] pci.device_spec                = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] pci.report_in_placement        = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.auth_section         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.auth_type            = password {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.cafile               = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.certfile             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.collect_timing       = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.connect_retries      = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.connect_retry_delay  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.default_domain_id    = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.default_domain_name  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.domain_id            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.domain_name          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.endpoint_override    = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.insecure             = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.keyfile              = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.max_version          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.min_version          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.password             = **** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.project_domain_id    = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.project_domain_name  = Default {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.project_id           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.project_name         = service {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.region_name          = RegionOne {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.service_name         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.service_type         = placement {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.split_loggers        = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.status_code_retries  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.status_code_retry_delay = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.system_scope         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.timeout              = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.trust_id             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.user_domain_id       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.user_domain_name     = Default {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.user_id              = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.username             = placement {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] placement.version              = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.cores                    = 20 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.count_usage_from_placement = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.injected_file_content_bytes = 10240 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.injected_file_path_length = 255 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.injected_files           = 5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.instances                = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.key_pairs                = 100 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.metadata_items           = 128 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.ram                      = 51200 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.recheck_quota            = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.server_group_members     = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] quota.server_groups            = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] rdp.enabled                    = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] scheduler.image_metadata_prefilter = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] scheduler.max_attempts         = 3 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] scheduler.max_placement_results = 1000 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] scheduler.workers              = 3 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.host_subset_size = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.isolated_hosts = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.isolated_images = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.pci_in_placement = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.track_instance_changes = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] metrics.required               = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] metrics.weight_multiplier      = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] metrics.weight_setting         = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] serial_console.enabled         = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] serial_console.port_range      = 10000:20000 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] serial_console.serialproxy_port = 6083 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] service_user.auth_section      = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] service_user.auth_type         = password {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] service_user.cafile            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] service_user.certfile          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] service_user.collect_timing    = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] service_user.insecure          = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] service_user.keyfile           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] service_user.send_service_user_token = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] service_user.split_loggers     = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] service_user.timeout           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] spice.agent_enabled            = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] spice.enabled                  = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] spice.html5proxy_port          = 6082 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] spice.image_compression        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] spice.jpeg_compression         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] spice.playback_compression     = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] spice.server_listen            = 127.0.0.1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] spice.streaming_mode           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] spice.zlib_compression         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] upgrade_levels.baseapi         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] upgrade_levels.cert            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] upgrade_levels.compute         = auto {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] upgrade_levels.conductor       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] upgrade_levels.scheduler       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vendordata_dynamic_auth.cafile = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vendordata_dynamic_auth.certfile = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vendordata_dynamic_auth.insecure = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vendordata_dynamic_auth.timeout = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.api_retry_count         = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.ca_file                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.cache_prefix            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.cluster_name            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.connection_pool_size    = 10 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.console_delay_seconds   = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.datastore_regex         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.host_ip                 = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.host_password           = **** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.host_port               = 443 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.host_username           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.insecure                = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.integration_bridge      = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.maximum_objects         = 100 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.pbm_default_policy      = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.pbm_enabled             = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.pbm_wsdl_location       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.serial_port_proxy_uri   = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.serial_port_service_uri = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.task_poll_interval      = 0.5 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.use_linked_clone        = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.vnc_keymap              = en-us {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.vnc_port                = 5900 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vmware.vnc_port_total          = 10000 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vnc.auth_schemes               = ['none'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vnc.enabled                    = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vnc.novncproxy_port            = 6080 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vnc.vencrypt_ca_certs          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vnc.vencrypt_client_cert       = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vnc.vencrypt_client_key        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.disable_rootwrap   = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.enable_numa_live_migration = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.libvirt_disable_apic = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] wsgi.client_socket_timeout     = 900 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] wsgi.default_pool_size         = 1000 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] wsgi.keep_alive                = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] wsgi.max_header_line           = 16384 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] wsgi.ssl_ca_file               = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] wsgi.ssl_cert_file             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] wsgi.ssl_key_file              = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] wsgi.tcp_keepidle              = 600 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] zvm.ca_file                    = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] zvm.cloud_connector_url        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] zvm.reachable_timeout          = 300 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_policy.enforce_new_defaults = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_policy.enforce_scope      = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_policy.policy_default_rule = default {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler.connection_string     = messaging:// {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler.enabled               = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler.es_doc_type           = notification {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler.es_scroll_size        = 10000 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler.es_scroll_time        = 2m {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler.filter_error_trace    = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler.hmac_keys             = **** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler.sentinel_service_name = mymaster {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler.socket_timeout        = 0.1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler.trace_requests        = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler.trace_sqlalchemy      = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler_jaeger.process_tags   = {} {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler_jaeger.service_name_prefix = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] profiler_otlp.service_name_prefix = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] remote_debug.host              = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] remote_debug.port              = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_notifications.retry = -1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.auth_section        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.auth_type           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.cafile              = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.certfile            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.collect_timing      = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.connect_retries     = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.connect_retry_delay = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.endpoint_id         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.endpoint_override   = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.insecure            = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.keyfile             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.max_version         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.min_version         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.region_name         = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.service_name        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.service_type        = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.split_loggers       = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.status_code_retries = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.status_code_retry_delay = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.timeout             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.valid_interfaces    = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_limit.version             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_reports.file_event_handler = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] oslo_reports.log_dir           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plug_ovs_privileged.group  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] vif_plug_ovs_privileged.user   = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_ovs.isolate_vif         = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] os_brick.lock_path             = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] privsep_osbrick.capabilities   = [21] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] privsep_osbrick.group          = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] privsep_osbrick.helper_command = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] privsep_osbrick.user           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] nova_sys_admin.group           = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] nova_sys_admin.helper_command  = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] nova_sys_admin.user            = None {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG oslo_service.service [None req-beb0aa07-7c60-433c-b567-2e534a3dfc62 None None] ******************************************************************************** {{(pid=72447) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 31 12:06:39 user nova-compute[72447]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 31 12:06:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Starting native event thread {{(pid=72447) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Starting green dispatch thread {{(pid=72447) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Starting connection event dispatch thread {{(pid=72447) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Connecting to libvirt: qemu:///system {{(pid=72447) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f06783cf790> {{(pid=72447) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 31 12:06:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f06783cf790> {{(pid=72447) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 31 12:06:39 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Connection event '1' reason 'None'
Jul 31 12:06:39 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 31 12:06:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.mount [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Initialising _HostMountState generation 0 {{(pid=72447) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 31 12:06:46 user nova-compute[72447]: INFO nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Libvirt host capabilities <capabilities>
Jul 31 12:06:46 user nova-compute[72447]:   <host>
Jul 31 12:06:46 user nova-compute[72447]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 31 12:06:46 user nova-compute[72447]:     <cpu>
Jul 31 12:06:46 user nova-compute[72447]:       <arch>x86_64</arch>
Jul 31 12:06:46 user nova-compute[72447]:       <model>IvyBridge-IBRS</model>
Jul 31 12:06:46 user nova-compute[72447]:       <vendor>Intel</vendor>
Jul 31 12:06:46 user nova-compute[72447]:       <microcode version='1070'/>
Jul 31 12:06:46 user nova-compute[72447]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 31 12:06:46 user nova-compute[72447]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='ss'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='vmx'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='pcid'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='osxsave'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='hypervisor'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='arat'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='tsc_adjust'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='md-clear'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='stibp'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='arch-capabilities'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='ssbd'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='invtsc'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='rsba'/>
Jul 31 12:06:46 user nova-compute[72447]:       <feature name='skip-l1dfl-vmentry'/>
Jul 31 12:06:46 user nova-compute[72447]:       <pages unit='KiB' size='4'/>
Jul 31 12:06:46 user nova-compute[72447]:       <pages unit='KiB' size='2048'/>
Jul 31 12:06:46 user nova-compute[72447]:     </cpu>
Jul 31 12:06:46 user nova-compute[72447]:     <power_management>
Jul 31 12:06:46 user nova-compute[72447]:       <suspend_mem/>
Jul 31 12:06:46 user nova-compute[72447]:       <suspend_disk/>
Jul 31 12:06:46 user nova-compute[72447]:       <suspend_hybrid/>
Jul 31 12:06:46 user nova-compute[72447]:     </power_management>
Jul 31 12:06:46 user nova-compute[72447]:     <iommu support='no'/>
Jul 31 12:06:46 user nova-compute[72447]:     <migration_features>
Jul 31 12:06:46 user nova-compute[72447]:       <live/>
Jul 31 12:06:46 user nova-compute[72447]:       <uri_transports>
Jul 31 12:06:46 user nova-compute[72447]:         <uri_transport>tcp</uri_transport>
Jul 31 12:06:46 user nova-compute[72447]:         <uri_transport>rdma</uri_transport>
Jul 31 12:06:46 user nova-compute[72447]:       </uri_transports>
Jul 31 12:06:46 user nova-compute[72447]:     </migration_features>
Jul 31 12:06:46 user nova-compute[72447]:     <topology>
Jul 31 12:06:46 user nova-compute[72447]:       <cells num='2'>
Jul 31 12:06:46 user nova-compute[72447]:         <cell id='0'>
Jul 31 12:06:46 user nova-compute[72447]:           <memory unit='KiB'>8140616</memory>
Jul 31 12:06:46 user nova-compute[72447]:           <pages unit='KiB' size='4'>2035154</pages>
Jul 31 12:06:46 user nova-compute[72447]:           <pages unit='KiB' size='2048'>0</pages>
Jul 31 12:06:46 user nova-compute[72447]:           <distances>
Jul 31 12:06:46 user nova-compute[72447]:             <sibling id='0' value='10'/>
Jul 31 12:06:46 user nova-compute[72447]:             <sibling id='1' value='20'/>
Jul 31 12:06:46 user nova-compute[72447]:           </distances>
Jul 31 12:06:46 user nova-compute[72447]:           <cpus num='6'>
Jul 31 12:06:46 user nova-compute[72447]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 31 12:06:46 user nova-compute[72447]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 31 12:06:46 user nova-compute[72447]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 31 12:06:46 user nova-compute[72447]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 31 12:06:46 user nova-compute[72447]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 31 12:06:46 user nova-compute[72447]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 31 12:06:46 user nova-compute[72447]:           </cpus>
Jul 31 12:06:46 user nova-compute[72447]:         </cell>
Jul 31 12:06:46 user nova-compute[72447]:         <cell id='1'>
Jul 31 12:06:46 user nova-compute[72447]:           <memory unit='KiB'>8255100</memory>
Jul 31 12:06:46 user nova-compute[72447]:           <pages unit='KiB' size='4'>2063775</pages>
Jul 31 12:06:46 user nova-compute[72447]:           <pages unit='KiB' size='2048'>0</pages>
Jul 31 12:06:46 user nova-compute[72447]:           <distances>
Jul 31 12:06:46 user nova-compute[72447]:             <sibling id='0' value='20'/>
Jul 31 12:06:46 user nova-compute[72447]:             <sibling id='1' value='10'/>
Jul 31 12:06:46 user nova-compute[72447]:           </distances>
Jul 31 12:06:46 user nova-compute[72447]:           <cpus num='6'>
Jul 31 12:06:46 user nova-compute[72447]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 31 12:06:46 user nova-compute[72447]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 31 12:06:46 user nova-compute[72447]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 31 12:06:46 user nova-compute[72447]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 31 12:06:46 user nova-compute[72447]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 31 12:06:46 user nova-compute[72447]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 31 12:06:46 user nova-compute[72447]:           </cpus>
Jul 31 12:06:46 user nova-compute[72447]:         </cell>
Jul 31 12:06:46 user nova-compute[72447]:       </cells>
Jul 31 12:06:46 user nova-compute[72447]:     </topology>
Jul 31 12:06:46 user nova-compute[72447]:     <cache>
Jul 31 12:06:46 user nova-compute[72447]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 31 12:06:46 user nova-compute[72447]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 31 12:06:46 user nova-compute[72447]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 31 12:06:46 user nova-compute[72447]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 31 12:06:46 user nova-compute[72447]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 31 12:06:46 user nova-compute[72447]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 31 12:06:46 user nova-compute[72447]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 31 12:06:46 user nova-compute[72447]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 31 12:06:46 user nova-compute[72447]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 31 12:06:46 user nova-compute[72447]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 31 12:06:46 user nova-compute[72447]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 31 12:06:46 user nova-compute[72447]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 31 12:06:46 user nova-compute[72447]:     </cache>
Jul 31 12:06:46 user nova-compute[72447]:     <secmodel>
Jul 31 12:06:46 user nova-compute[72447]:       <model>apparmor</model>
Jul 31 12:06:46 user nova-compute[72447]:       <doi>0</doi>
Jul 31 12:06:46 user nova-compute[72447]:     </secmodel>
Jul 31 12:06:46 user nova-compute[72447]:     <secmodel>
Jul 31 12:06:46 user nova-compute[72447]:       <model>dac</model>
Jul 31 12:06:46 user nova-compute[72447]:       <doi>0</doi>
Jul 31 12:06:46 user nova-compute[72447]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 31 12:06:46 user nova-compute[72447]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 31 12:06:46 user nova-compute[72447]:     </secmodel>
Jul 31 12:06:46 user nova-compute[72447]:   </host>
Jul 31 12:06:46 user nova-compute[72447]:   <guest>
Jul 31 12:06:46 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:46 user nova-compute[72447]:     <arch name='alpha'>
Jul 31 12:06:46 user nova-compute[72447]:       <wordsize>64</wordsize>
Jul 31 12:06:46 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>clipper</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:46 user nova-compute[72447]:     </arch>
Jul 31 12:06:46 user nova-compute[72447]:     <features>
Jul 31 12:06:46 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:46 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:46 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:46 user nova-compute[72447]:     </features>
Jul 31 12:06:46 user nova-compute[72447]:   </guest>
Jul 31 12:06:46 user nova-compute[72447]:   <guest>
Jul 31 12:06:46 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:46 user nova-compute[72447]:     <arch name='armv6l'>
Jul 31 12:06:46 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:46 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>integratorcp</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>borzoi</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>spitz</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>nuri</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>musca-b1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>versatileab</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>kzm</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>musca-a</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>smdkc210</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>sx1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>z2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>tosa</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>sabrelite</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>realview-eb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>n810</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>n800</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>versatilepb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>terrier</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mainstone</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>midway</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>musicpal</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>microbit</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>cubieboard</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>verdex</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>netduino2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>raspi2b</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>cheetah</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>highbank</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>akita</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>connex</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>collie</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>raspi0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:46 user nova-compute[72447]:     </arch>
Jul 31 12:06:46 user nova-compute[72447]:     <features>
Jul 31 12:06:46 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:46 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:46 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:46 user nova-compute[72447]:     </features>
Jul 31 12:06:46 user nova-compute[72447]:   </guest>
Jul 31 12:06:46 user nova-compute[72447]:   <guest>
Jul 31 12:06:46 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:46 user nova-compute[72447]:     <arch name='armv7l'>
Jul 31 12:06:46 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:46 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>integratorcp</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>borzoi</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>spitz</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>nuri</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>musca-b1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>versatileab</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>kzm</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>musca-a</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>smdkc210</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>sx1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>z2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>tosa</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>sabrelite</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>realview-eb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>n810</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>n800</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>versatilepb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>terrier</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mainstone</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>midway</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>musicpal</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>microbit</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>cubieboard</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>verdex</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>netduino2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>raspi2b</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>cheetah</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>highbank</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>akita</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>connex</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>collie</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>raspi0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:46 user nova-compute[72447]:     </arch>
Jul 31 12:06:46 user nova-compute[72447]:     <features>
Jul 31 12:06:46 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:46 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:46 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:46 user nova-compute[72447]:     </features>
Jul 31 12:06:46 user nova-compute[72447]:   </guest>
Jul 31 12:06:46 user nova-compute[72447]:   <guest>
Jul 31 12:06:46 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:46 user nova-compute[72447]:     <arch name='aarch64'>
Jul 31 12:06:46 user nova-compute[72447]:       <wordsize>64</wordsize>
Jul 31 12:06:46 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>integratorcp</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>borzoi</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>spitz</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>nuri</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>musca-b1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>versatileab</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>kzm</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>musca-a</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>smdkc210</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>sx1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>z2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>tosa</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>sabrelite</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>realview-eb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>n810</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>n800</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>versatilepb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>terrier</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mainstone</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>midway</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>musicpal</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>microbit</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>cubieboard</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>verdex</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>netduino2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>raspi3b</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>raspi2b</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>cheetah</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='4'>highbank</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>akita</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>connex</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>collie</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>raspi0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:46 user nova-compute[72447]:     </arch>
Jul 31 12:06:46 user nova-compute[72447]:     <features>
Jul 31 12:06:46 user nova-compute[72447]:       <acpi default='on' toggle='yes'/>
Jul 31 12:06:46 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:46 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:46 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:46 user nova-compute[72447]:     </features>
Jul 31 12:06:46 user nova-compute[72447]:   </guest>
Jul 31 12:06:46 user nova-compute[72447]:   <guest>
Jul 31 12:06:46 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:46 user nova-compute[72447]:     <arch name='cris'>
Jul 31 12:06:46 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:46 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:46 user nova-compute[72447]:     </arch>
Jul 31 12:06:46 user nova-compute[72447]:     <features>
Jul 31 12:06:46 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:46 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:46 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:46 user nova-compute[72447]:     </features>
Jul 31 12:06:46 user nova-compute[72447]:   </guest>
Jul 31 12:06:46 user nova-compute[72447]:   <guest>
Jul 31 12:06:46 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:46 user nova-compute[72447]:     <arch name='i686'>
Jul 31 12:06:46 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:46 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='1'>x-remote</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 31 12:06:46 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>isapc</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>microvm</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='kvm'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <pae/>
Jul 31 12:06:47 user nova-compute[72447]:       <nonpae/>
Jul 31 12:06:47 user nova-compute[72447]:       <acpi default='on' toggle='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:       <apic default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='m68k'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>an5206</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>q800</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>next-cube</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='microblaze'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='microblazeel'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='mips'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='16'>malta</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='mipsel'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='16'>malta</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='mips64'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>64</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='16'>malta</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>pica61</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>magnum</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='mips64el'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>64</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='16'>malta</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>pica61</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>magnum</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='16'>boston</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='ppc'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>g3beige</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>mac99</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>ppce500</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>pegasos2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>sam460ex</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>bamboo</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>40p</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>ref405ep</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>taihu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='ppc64'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>64</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2048'>powernv9</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>taihu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2048'>powernv10</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>ppce500</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>40p</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>pegasos2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>bamboo</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>g3beige</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>mac99</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>sam460ex</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>ref405ep</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2048'>powernv8</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='ppc64le'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>64</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2048'>powernv9</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>taihu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2048'>powernv10</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>ppce500</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>40p</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>pegasos2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>bamboo</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>g3beige</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>mac99</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>sam460ex</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>ref405ep</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2048'>powernv8</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='riscv32'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='8'>spike</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>opentitan</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='5'>sifive_u</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>sifive_e</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='8'>virt</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='riscv64'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>64</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='8'>spike</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='5'>sifive_u</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>shakti_c</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>sifive_e</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='8'>virt</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='s390x'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>64</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='sh4'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>shix</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>r2d</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='sh4eb'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>64</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>shix</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>r2d</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='sparc'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>SS-5</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='4'>SS-20</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>LX</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>SS-4</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='4'>SS-10</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>Voyager</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='sparc64'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>64</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>sun4u</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>niagara</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>sun4v</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='x86_64'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>64</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>x-remote</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='1'>isapc</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>microvm</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='kvm'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <acpi default='on' toggle='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:       <apic default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='xtensa'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='4'>sim</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>kc705</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>ml605</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>virt</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>lx200</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>lx60</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]:   <guest>
Jul 31 12:06:47 user nova-compute[72447]:     <os_type>hvm</os_type>
Jul 31 12:06:47 user nova-compute[72447]:     <arch name='xtensaeb'>
Jul 31 12:06:47 user nova-compute[72447]:       <wordsize>32</wordsize>
Jul 31 12:06:47 user nova-compute[72447]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='4'>sim</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>kc705</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>ml605</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>virt</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>lx200</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>lx60</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 31 12:06:47 user nova-compute[72447]:       <domain type='qemu'/>
Jul 31 12:06:47 user nova-compute[72447]:     </arch>
Jul 31 12:06:47 user nova-compute[72447]:     <features>
Jul 31 12:06:47 user nova-compute[72447]:       <cpuselection/>
Jul 31 12:06:47 user nova-compute[72447]:       <deviceboot/>
Jul 31 12:06:47 user nova-compute[72447]:       <disksnapshot default='on' toggle='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     </features>
Jul 31 12:06:47 user nova-compute[72447]:   </guest>
Jul 31 12:06:47 user nova-compute[72447]: </capabilities>
Jul 31 12:06:47 user nova-compute[72447]: 
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 31 12:06:47 user nova-compute[72447]: <domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 12:06:47 user nova-compute[72447]:   <domain>kvm</domain>
Jul 31 12:06:47 user nova-compute[72447]:   <machine>pc-q35-6.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:   <arch>i686</arch>
Jul 31 12:06:47 user nova-compute[72447]:   <vcpu max='288'/>
Jul 31 12:06:47 user nova-compute[72447]:   <iothreads supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:   <os supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='firmware'/>
Jul 31 12:06:47 user nova-compute[72447]:     <loader supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>rom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pflash</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='readonly'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>yes</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='secure'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </loader>
Jul 31 12:06:47 user nova-compute[72447]:   </os>
Jul 31 12:06:47 user nova-compute[72447]:   <cpu>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-passthrough' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='hostPassthroughMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='maximum' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='maximumMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>on</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-model' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <vendor>Intel</vendor>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ss'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='vmx'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='pcid'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='hypervisor'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arat'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='umip'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='md-clear'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibpb'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibrs'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='erms'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='lm'/>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='custom' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>qemu64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>qemu32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>phenom</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>n270</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>kvm64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>kvm32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>coreduo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>core2duo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>athlon</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Westmere</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Snowridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Penryn</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G5</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G4</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G1</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Nehalem</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Rome</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Milan</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Dhyana</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cooperlake</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Conroe</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>486</model>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:   </cpu>
Jul 31 12:06:47 user nova-compute[72447]:   <memoryBacking supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='sourceType'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>file</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>anonymous</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>memfd</value>
Jul 31 12:06:47 user nova-compute[72447]:     </enum>
Jul 31 12:06:47 user nova-compute[72447]:   </memoryBacking>
Jul 31 12:06:47 user nova-compute[72447]:   <devices>
Jul 31 12:06:47 user nova-compute[72447]:     <disk supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='diskDevice'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>disk</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cdrom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>floppy</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>lun</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='bus'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>fdc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sata</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </disk>
Jul 31 12:06:47 user nova-compute[72447]:     <graphics supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sdl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vnc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>spice</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egl-headless</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </graphics>
Jul 31 12:06:47 user nova-compute[72447]:     <video supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='modelType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cirrus</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vmvga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>qxl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>none</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>bochs</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>ramfb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </video>
Jul 31 12:06:47 user nova-compute[72447]:     <hostdev supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='mode'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>subsystem</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='startupPolicy'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>default</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>mandatory</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>requisite</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>optional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='subsysType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pci</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='capsType'/>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='pciBackend'/>
Jul 31 12:06:47 user nova-compute[72447]:     </hostdev>
Jul 31 12:06:47 user nova-compute[72447]:     <rng supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>random</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egd</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>builtin</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </rng>
Jul 31 12:06:47 user nova-compute[72447]:     <filesystem supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='driverType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>path</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>handle</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtiofs</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </filesystem>
Jul 31 12:06:47 user nova-compute[72447]:     <tpm supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-tis</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-crb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>passthrough</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>emulator</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </tpm>
Jul 31 12:06:47 user nova-compute[72447]:   </devices>
Jul 31 12:06:47 user nova-compute[72447]:   <features>
Jul 31 12:06:47 user nova-compute[72447]:     <gic supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     <vmcoreinfo supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <genid supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backingStoreInput supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backup supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <sev supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:   </features>
Jul 31 12:06:47 user nova-compute[72447]: </domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:  {{(pid=72447) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 31 12:06:47 user nova-compute[72447]: <domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 12:06:47 user nova-compute[72447]:   <domain>kvm</domain>
Jul 31 12:06:47 user nova-compute[72447]:   <machine>pc-q35-jammy</machine>
Jul 31 12:06:47 user nova-compute[72447]:   <arch>i686</arch>
Jul 31 12:06:47 user nova-compute[72447]:   <vcpu max='288'/>
Jul 31 12:06:47 user nova-compute[72447]:   <iothreads supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:   <os supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='firmware'/>
Jul 31 12:06:47 user nova-compute[72447]:     <loader supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>rom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pflash</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='readonly'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>yes</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='secure'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </loader>
Jul 31 12:06:47 user nova-compute[72447]:   </os>
Jul 31 12:06:47 user nova-compute[72447]:   <cpu>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-passthrough' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='hostPassthroughMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='maximum' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='maximumMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>on</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-model' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <vendor>Intel</vendor>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ss'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='vmx'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='pcid'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='hypervisor'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arat'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='umip'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='md-clear'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibpb'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibrs'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='erms'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='lm'/>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='custom' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>qemu64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>qemu32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>phenom</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>n270</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>kvm64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>kvm32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>coreduo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>core2duo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>athlon</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Westmere</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Snowridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Penryn</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G5</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G4</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G1</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Nehalem</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Rome</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Milan</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Dhyana</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cooperlake</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Conroe</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>486</model>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:   </cpu>
Jul 31 12:06:47 user nova-compute[72447]:   <memoryBacking supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='sourceType'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>file</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>anonymous</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>memfd</value>
Jul 31 12:06:47 user nova-compute[72447]:     </enum>
Jul 31 12:06:47 user nova-compute[72447]:   </memoryBacking>
Jul 31 12:06:47 user nova-compute[72447]:   <devices>
Jul 31 12:06:47 user nova-compute[72447]:     <disk supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='diskDevice'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>disk</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cdrom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>floppy</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>lun</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='bus'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>fdc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sata</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </disk>
Jul 31 12:06:47 user nova-compute[72447]:     <graphics supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sdl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vnc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>spice</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egl-headless</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </graphics>
Jul 31 12:06:47 user nova-compute[72447]:     <video supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='modelType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cirrus</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vmvga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>qxl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>none</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>bochs</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>ramfb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </video>
Jul 31 12:06:47 user nova-compute[72447]:     <hostdev supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='mode'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>subsystem</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='startupPolicy'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>default</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>mandatory</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>requisite</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>optional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='subsysType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pci</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='capsType'/>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='pciBackend'/>
Jul 31 12:06:47 user nova-compute[72447]:     </hostdev>
Jul 31 12:06:47 user nova-compute[72447]:     <rng supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>random</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egd</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>builtin</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </rng>
Jul 31 12:06:47 user nova-compute[72447]:     <filesystem supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='driverType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>path</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>handle</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtiofs</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </filesystem>
Jul 31 12:06:47 user nova-compute[72447]:     <tpm supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-tis</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-crb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>passthrough</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>emulator</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </tpm>
Jul 31 12:06:47 user nova-compute[72447]:   </devices>
Jul 31 12:06:47 user nova-compute[72447]:   <features>
Jul 31 12:06:47 user nova-compute[72447]:     <gic supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     <vmcoreinfo supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <genid supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backingStoreInput supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backup supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <sev supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:   </features>
Jul 31 12:06:47 user nova-compute[72447]: </domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:  {{(pid=72447) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 31 12:06:47 user nova-compute[72447]: <domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 12:06:47 user nova-compute[72447]:   <domain>kvm</domain>
Jul 31 12:06:47 user nova-compute[72447]:   <machine>pc-i440fx-jammy</machine>
Jul 31 12:06:47 user nova-compute[72447]:   <arch>i686</arch>
Jul 31 12:06:47 user nova-compute[72447]:   <vcpu max='255'/>
Jul 31 12:06:47 user nova-compute[72447]:   <iothreads supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:   <os supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='firmware'/>
Jul 31 12:06:47 user nova-compute[72447]:     <loader supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>rom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pflash</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='readonly'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>yes</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='secure'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </loader>
Jul 31 12:06:47 user nova-compute[72447]:   </os>
Jul 31 12:06:47 user nova-compute[72447]:   <cpu>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-passthrough' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='hostPassthroughMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='maximum' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='maximumMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>on</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-model' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <vendor>Intel</vendor>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ss'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='vmx'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='pcid'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='hypervisor'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arat'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='umip'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='md-clear'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibpb'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibrs'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='erms'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='lm'/>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='custom' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>qemu64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>qemu32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>phenom</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>n270</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>kvm64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>kvm32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>coreduo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>core2duo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>athlon</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Westmere</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Snowridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Penryn</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G5</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G4</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G1</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Nehalem</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Rome</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Milan</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Dhyana</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cooperlake</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Conroe</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>486</model>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:   </cpu>
Jul 31 12:06:47 user nova-compute[72447]:   <memoryBacking supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='sourceType'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>file</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>anonymous</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>memfd</value>
Jul 31 12:06:47 user nova-compute[72447]:     </enum>
Jul 31 12:06:47 user nova-compute[72447]:   </memoryBacking>
Jul 31 12:06:47 user nova-compute[72447]:   <devices>
Jul 31 12:06:47 user nova-compute[72447]:     <disk supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='diskDevice'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>disk</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cdrom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>floppy</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>lun</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='bus'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>ide</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>fdc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sata</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </disk>
Jul 31 12:06:47 user nova-compute[72447]:     <graphics supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sdl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vnc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>spice</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egl-headless</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </graphics>
Jul 31 12:06:47 user nova-compute[72447]:     <video supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='modelType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cirrus</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vmvga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>qxl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>none</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>bochs</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>ramfb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </video>
Jul 31 12:06:47 user nova-compute[72447]:     <hostdev supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='mode'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>subsystem</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='startupPolicy'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>default</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>mandatory</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>requisite</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>optional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='subsysType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pci</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='capsType'/>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='pciBackend'/>
Jul 31 12:06:47 user nova-compute[72447]:     </hostdev>
Jul 31 12:06:47 user nova-compute[72447]:     <rng supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>random</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egd</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>builtin</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </rng>
Jul 31 12:06:47 user nova-compute[72447]:     <filesystem supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='driverType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>path</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>handle</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtiofs</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </filesystem>
Jul 31 12:06:47 user nova-compute[72447]:     <tpm supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-tis</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-crb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>passthrough</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>emulator</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </tpm>
Jul 31 12:06:47 user nova-compute[72447]:   </devices>
Jul 31 12:06:47 user nova-compute[72447]:   <features>
Jul 31 12:06:47 user nova-compute[72447]:     <gic supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     <vmcoreinfo supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <genid supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backingStoreInput supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backup supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <sev supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:   </features>
Jul 31 12:06:47 user nova-compute[72447]: </domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:  {{(pid=72447) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 31 12:06:47 user nova-compute[72447]: <domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 12:06:47 user nova-compute[72447]:   <domain>kvm</domain>
Jul 31 12:06:47 user nova-compute[72447]:   <machine>pc-i440fx-6.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:   <arch>i686</arch>
Jul 31 12:06:47 user nova-compute[72447]:   <vcpu max='255'/>
Jul 31 12:06:47 user nova-compute[72447]:   <iothreads supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:   <os supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='firmware'/>
Jul 31 12:06:47 user nova-compute[72447]:     <loader supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>rom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pflash</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='readonly'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>yes</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='secure'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </loader>
Jul 31 12:06:47 user nova-compute[72447]:   </os>
Jul 31 12:06:47 user nova-compute[72447]:   <cpu>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-passthrough' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='hostPassthroughMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='maximum' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='maximumMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>on</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-model' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <vendor>Intel</vendor>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ss'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='vmx'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='pcid'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='hypervisor'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arat'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='umip'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='md-clear'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibpb'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibrs'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='erms'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='lm'/>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='custom' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>qemu64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>qemu32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>phenom</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>n270</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>kvm64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>kvm32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>coreduo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>core2duo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>athlon</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Westmere</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Snowridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Penryn</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G5</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G4</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G1</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Nehalem</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Rome</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Milan</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Dhyana</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cooperlake</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Conroe</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>486</model>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:   </cpu>
Jul 31 12:06:47 user nova-compute[72447]:   <memoryBacking supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='sourceType'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>file</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>anonymous</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>memfd</value>
Jul 31 12:06:47 user nova-compute[72447]:     </enum>
Jul 31 12:06:47 user nova-compute[72447]:   </memoryBacking>
Jul 31 12:06:47 user nova-compute[72447]:   <devices>
Jul 31 12:06:47 user nova-compute[72447]:     <disk supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='diskDevice'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>disk</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cdrom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>floppy</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>lun</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='bus'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>ide</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>fdc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sata</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </disk>
Jul 31 12:06:47 user nova-compute[72447]:     <graphics supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sdl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vnc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>spice</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egl-headless</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </graphics>
Jul 31 12:06:47 user nova-compute[72447]:     <video supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='modelType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cirrus</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vmvga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>qxl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>none</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>bochs</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>ramfb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </video>
Jul 31 12:06:47 user nova-compute[72447]:     <hostdev supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='mode'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>subsystem</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='startupPolicy'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>default</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>mandatory</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>requisite</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>optional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='subsysType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pci</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='capsType'/>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='pciBackend'/>
Jul 31 12:06:47 user nova-compute[72447]:     </hostdev>
Jul 31 12:06:47 user nova-compute[72447]:     <rng supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>random</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egd</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>builtin</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </rng>
Jul 31 12:06:47 user nova-compute[72447]:     <filesystem supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='driverType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>path</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>handle</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtiofs</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </filesystem>
Jul 31 12:06:47 user nova-compute[72447]:     <tpm supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-tis</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-crb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>passthrough</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>emulator</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </tpm>
Jul 31 12:06:47 user nova-compute[72447]:   </devices>
Jul 31 12:06:47 user nova-compute[72447]:   <features>
Jul 31 12:06:47 user nova-compute[72447]:     <gic supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     <vmcoreinfo supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <genid supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backingStoreInput supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backup supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <sev supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:   </features>
Jul 31 12:06:47 user nova-compute[72447]: </domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:  {{(pid=72447) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 31 12:06:47 user nova-compute[72447]: <domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 12:06:47 user nova-compute[72447]:   <domain>kvm</domain>
Jul 31 12:06:47 user nova-compute[72447]:   <machine>pc-q35-6.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:   <arch>x86_64</arch>
Jul 31 12:06:47 user nova-compute[72447]:   <vcpu max='288'/>
Jul 31 12:06:47 user nova-compute[72447]:   <iothreads supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:   <os supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='firmware'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>efi</value>
Jul 31 12:06:47 user nova-compute[72447]:     </enum>
Jul 31 12:06:47 user nova-compute[72447]:     <loader supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>rom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pflash</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='readonly'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>yes</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='secure'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>yes</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </loader>
Jul 31 12:06:47 user nova-compute[72447]:   </os>
Jul 31 12:06:47 user nova-compute[72447]:   <cpu>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-passthrough' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='hostPassthroughMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>on</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='maximum' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='maximumMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>on</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-model' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <vendor>Intel</vendor>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ss'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='vmx'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='pcid'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='hypervisor'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arat'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='umip'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='md-clear'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='invtsc'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibpb'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibrs'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='rsba'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='erms'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='custom' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>qemu64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>qemu32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>phenom</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>n270</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>kvm64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>kvm32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>coreduo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>core2duo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>athlon</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Westmere</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Snowridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Penryn</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G5</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G4</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Opteron_G1</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Nehalem</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Rome</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Milan</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Dhyana</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cooperlake</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Conroe</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>486</model>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:   </cpu>
Jul 31 12:06:47 user nova-compute[72447]:   <memoryBacking supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='sourceType'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>file</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>anonymous</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>memfd</value>
Jul 31 12:06:47 user nova-compute[72447]:     </enum>
Jul 31 12:06:47 user nova-compute[72447]:   </memoryBacking>
Jul 31 12:06:47 user nova-compute[72447]:   <devices>
Jul 31 12:06:47 user nova-compute[72447]:     <disk supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='diskDevice'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>disk</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cdrom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>floppy</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>lun</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='bus'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>fdc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sata</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </disk>
Jul 31 12:06:47 user nova-compute[72447]:     <graphics supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sdl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vnc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>spice</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egl-headless</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </graphics>
Jul 31 12:06:47 user nova-compute[72447]:     <video supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='modelType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cirrus</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vmvga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>qxl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>none</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>bochs</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>ramfb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </video>
Jul 31 12:06:47 user nova-compute[72447]:     <hostdev supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='mode'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>subsystem</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='startupPolicy'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>default</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>mandatory</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>requisite</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>optional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='subsysType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pci</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='capsType'/>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='pciBackend'/>
Jul 31 12:06:47 user nova-compute[72447]:     </hostdev>
Jul 31 12:06:47 user nova-compute[72447]:     <rng supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>random</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egd</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>builtin</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </rng>
Jul 31 12:06:47 user nova-compute[72447]:     <filesystem supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='driverType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>path</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>handle</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtiofs</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </filesystem>
Jul 31 12:06:47 user nova-compute[72447]:     <tpm supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-tis</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-crb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>passthrough</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>emulator</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </tpm>
Jul 31 12:06:47 user nova-compute[72447]:   </devices>
Jul 31 12:06:47 user nova-compute[72447]:   <features>
Jul 31 12:06:47 user nova-compute[72447]:     <gic supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     <vmcoreinfo supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <genid supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backingStoreInput supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backup supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <sev supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:   </features>
Jul 31 12:06:47 user nova-compute[72447]: </domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:  {{(pid=72447) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 31 12:06:47 user nova-compute[72447]: <domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 12:06:47 user nova-compute[72447]:   <domain>kvm</domain>
Jul 31 12:06:47 user nova-compute[72447]:   <machine>pc-q35-jammy</machine>
Jul 31 12:06:47 user nova-compute[72447]:   <arch>x86_64</arch>
Jul 31 12:06:47 user nova-compute[72447]:   <vcpu max='288'/>
Jul 31 12:06:47 user nova-compute[72447]:   <iothreads supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:   <os supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='firmware'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>efi</value>
Jul 31 12:06:47 user nova-compute[72447]:     </enum>
Jul 31 12:06:47 user nova-compute[72447]:     <loader supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>rom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pflash</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='readonly'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>yes</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='secure'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>yes</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </loader>
Jul 31 12:06:47 user nova-compute[72447]:   </os>
Jul 31 12:06:47 user nova-compute[72447]:   <cpu>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-passthrough' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='hostPassthroughMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>on</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='maximum' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='maximumMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>on</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-model' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <vendor>Intel</vendor>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ss'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='vmx'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='pcid'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='hypervisor'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arat'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='umip'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='md-clear'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='invtsc'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibpb'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibrs'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='rsba'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='erms'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='custom' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>qemu64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>qemu32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>phenom</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>n270</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>kvm64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>kvm32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>coreduo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>core2duo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>athlon</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Westmere</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Snowridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Penryn</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G5</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G4</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Opteron_G1</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Nehalem</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Rome</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Milan</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Dhyana</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cooperlake</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Conroe</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>486</model>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:   </cpu>
Jul 31 12:06:47 user nova-compute[72447]:   <memoryBacking supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='sourceType'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>file</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>anonymous</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>memfd</value>
Jul 31 12:06:47 user nova-compute[72447]:     </enum>
Jul 31 12:06:47 user nova-compute[72447]:   </memoryBacking>
Jul 31 12:06:47 user nova-compute[72447]:   <devices>
Jul 31 12:06:47 user nova-compute[72447]:     <disk supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='diskDevice'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>disk</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cdrom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>floppy</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>lun</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='bus'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>fdc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sata</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </disk>
Jul 31 12:06:47 user nova-compute[72447]:     <graphics supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sdl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vnc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>spice</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egl-headless</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </graphics>
Jul 31 12:06:47 user nova-compute[72447]:     <video supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='modelType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cirrus</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vmvga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>qxl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>none</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>bochs</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>ramfb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </video>
Jul 31 12:06:47 user nova-compute[72447]:     <hostdev supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='mode'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>subsystem</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='startupPolicy'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>default</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>mandatory</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>requisite</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>optional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='subsysType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pci</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='capsType'/>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='pciBackend'/>
Jul 31 12:06:47 user nova-compute[72447]:     </hostdev>
Jul 31 12:06:47 user nova-compute[72447]:     <rng supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>random</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egd</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>builtin</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </rng>
Jul 31 12:06:47 user nova-compute[72447]:     <filesystem supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='driverType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>path</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>handle</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtiofs</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </filesystem>
Jul 31 12:06:47 user nova-compute[72447]:     <tpm supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-tis</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-crb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>passthrough</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>emulator</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </tpm>
Jul 31 12:06:47 user nova-compute[72447]:   </devices>
Jul 31 12:06:47 user nova-compute[72447]:   <features>
Jul 31 12:06:47 user nova-compute[72447]:     <gic supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     <vmcoreinfo supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <genid supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backingStoreInput supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backup supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <sev supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:   </features>
Jul 31 12:06:47 user nova-compute[72447]: </domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:  {{(pid=72447) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 31 12:06:47 user nova-compute[72447]: <domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 12:06:47 user nova-compute[72447]:   <domain>kvm</domain>
Jul 31 12:06:47 user nova-compute[72447]:   <machine>pc-i440fx-jammy</machine>
Jul 31 12:06:47 user nova-compute[72447]:   <arch>x86_64</arch>
Jul 31 12:06:47 user nova-compute[72447]:   <vcpu max='255'/>
Jul 31 12:06:47 user nova-compute[72447]:   <iothreads supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:   <os supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='firmware'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>efi</value>
Jul 31 12:06:47 user nova-compute[72447]:     </enum>
Jul 31 12:06:47 user nova-compute[72447]:     <loader supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>rom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pflash</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='readonly'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>yes</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='secure'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </loader>
Jul 31 12:06:47 user nova-compute[72447]:   </os>
Jul 31 12:06:47 user nova-compute[72447]:   <cpu>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-passthrough' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='hostPassthroughMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>on</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='maximum' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='maximumMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>on</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-model' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <vendor>Intel</vendor>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ss'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='vmx'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='pcid'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='hypervisor'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arat'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='umip'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='md-clear'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='invtsc'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibpb'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibrs'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='rsba'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='erms'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='custom' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>qemu64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>qemu32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>phenom</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>n270</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>kvm64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>kvm32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>coreduo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>core2duo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>athlon</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Westmere</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Snowridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Penryn</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G5</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G4</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Opteron_G1</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Nehalem</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Rome</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Milan</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Dhyana</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cooperlake</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Conroe</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>486</model>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:   </cpu>
Jul 31 12:06:47 user nova-compute[72447]:   <memoryBacking supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='sourceType'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>file</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>anonymous</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>memfd</value>
Jul 31 12:06:47 user nova-compute[72447]:     </enum>
Jul 31 12:06:47 user nova-compute[72447]:   </memoryBacking>
Jul 31 12:06:47 user nova-compute[72447]:   <devices>
Jul 31 12:06:47 user nova-compute[72447]:     <disk supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='diskDevice'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>disk</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cdrom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>floppy</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>lun</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='bus'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>ide</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>fdc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sata</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </disk>
Jul 31 12:06:47 user nova-compute[72447]:     <graphics supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sdl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vnc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>spice</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egl-headless</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </graphics>
Jul 31 12:06:47 user nova-compute[72447]:     <video supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='modelType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cirrus</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vmvga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>qxl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>none</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>bochs</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>ramfb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </video>
Jul 31 12:06:47 user nova-compute[72447]:     <hostdev supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='mode'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>subsystem</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='startupPolicy'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>default</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>mandatory</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>requisite</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>optional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='subsysType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pci</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='capsType'/>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='pciBackend'/>
Jul 31 12:06:47 user nova-compute[72447]:     </hostdev>
Jul 31 12:06:47 user nova-compute[72447]:     <rng supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>random</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egd</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>builtin</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </rng>
Jul 31 12:06:47 user nova-compute[72447]:     <filesystem supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='driverType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>path</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>handle</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtiofs</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </filesystem>
Jul 31 12:06:47 user nova-compute[72447]:     <tpm supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-tis</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-crb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>passthrough</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>emulator</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </tpm>
Jul 31 12:06:47 user nova-compute[72447]:   </devices>
Jul 31 12:06:47 user nova-compute[72447]:   <features>
Jul 31 12:06:47 user nova-compute[72447]:     <gic supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     <vmcoreinfo supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <genid supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backingStoreInput supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backup supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <sev supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:   </features>
Jul 31 12:06:47 user nova-compute[72447]: </domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:  {{(pid=72447) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 31 12:06:47 user nova-compute[72447]: <domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 12:06:47 user nova-compute[72447]:   <domain>kvm</domain>
Jul 31 12:06:47 user nova-compute[72447]:   <machine>pc-i440fx-6.2</machine>
Jul 31 12:06:47 user nova-compute[72447]:   <arch>x86_64</arch>
Jul 31 12:06:47 user nova-compute[72447]:   <vcpu max='255'/>
Jul 31 12:06:47 user nova-compute[72447]:   <iothreads supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:   <os supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='firmware'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>efi</value>
Jul 31 12:06:47 user nova-compute[72447]:     </enum>
Jul 31 12:06:47 user nova-compute[72447]:     <loader supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>rom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pflash</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='readonly'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>yes</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='secure'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>no</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </loader>
Jul 31 12:06:47 user nova-compute[72447]:   </os>
Jul 31 12:06:47 user nova-compute[72447]:   <cpu>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-passthrough' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='hostPassthroughMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>on</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='maximum' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='maximumMigratable'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>on</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>off</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='host-model' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <vendor>Intel</vendor>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ss'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='vmx'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='pcid'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='hypervisor'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arat'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='umip'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='md-clear'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='invtsc'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibpb'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='ibrs'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-stibp'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='rsba'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='erms'/>
Jul 31 12:06:47 user nova-compute[72447]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:     <mode name='custom' supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>qemu64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>qemu32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>phenom</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>pentium</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>n270</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>kvm64</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>kvm32</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>coreduo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>core2duo</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>athlon</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Westmere</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Snowridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Skylake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>SandyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Penryn</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G5</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G4</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G3</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Opteron_G2</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Opteron_G1</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Nehalem</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>IvyBridge</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Icelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Haswell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Rome</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-Milan</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>EPYC</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Dhyana</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cooperlake</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>Conroe</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='no'>Broadwell</model>
Jul 31 12:06:47 user nova-compute[72447]:       <model usable='yes'>486</model>
Jul 31 12:06:47 user nova-compute[72447]:     </mode>
Jul 31 12:06:47 user nova-compute[72447]:   </cpu>
Jul 31 12:06:47 user nova-compute[72447]:   <memoryBacking supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:     <enum name='sourceType'>
Jul 31 12:06:47 user nova-compute[72447]:       <value>file</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>anonymous</value>
Jul 31 12:06:47 user nova-compute[72447]:       <value>memfd</value>
Jul 31 12:06:47 user nova-compute[72447]:     </enum>
Jul 31 12:06:47 user nova-compute[72447]:   </memoryBacking>
Jul 31 12:06:47 user nova-compute[72447]:   <devices>
Jul 31 12:06:47 user nova-compute[72447]:     <disk supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='diskDevice'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>disk</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cdrom</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>floppy</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>lun</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='bus'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>ide</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>fdc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sata</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </disk>
Jul 31 12:06:47 user nova-compute[72447]:     <graphics supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='type'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>sdl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vnc</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>spice</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egl-headless</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </graphics>
Jul 31 12:06:47 user nova-compute[72447]:     <video supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='modelType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>cirrus</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>vmvga</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>qxl</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>none</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>bochs</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>ramfb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </video>
Jul 31 12:06:47 user nova-compute[72447]:     <hostdev supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='mode'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>subsystem</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='startupPolicy'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>default</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>mandatory</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>requisite</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>optional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='subsysType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>usb</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>pci</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>scsi</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='capsType'/>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='pciBackend'/>
Jul 31 12:06:47 user nova-compute[72447]:     </hostdev>
Jul 31 12:06:47 user nova-compute[72447]:     <rng supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtio-non-transitional</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>random</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>egd</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>builtin</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </rng>
Jul 31 12:06:47 user nova-compute[72447]:     <filesystem supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='driverType'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>path</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>handle</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>virtiofs</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </filesystem>
Jul 31 12:06:47 user nova-compute[72447]:     <tpm supported='yes'>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='model'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-tis</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>tpm-crb</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:       <enum name='backendModel'>
Jul 31 12:06:47 user nova-compute[72447]:         <value>passthrough</value>
Jul 31 12:06:47 user nova-compute[72447]:         <value>emulator</value>
Jul 31 12:06:47 user nova-compute[72447]:       </enum>
Jul 31 12:06:47 user nova-compute[72447]:     </tpm>
Jul 31 12:06:47 user nova-compute[72447]:   </devices>
Jul 31 12:06:47 user nova-compute[72447]:   <features>
Jul 31 12:06:47 user nova-compute[72447]:     <gic supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:     <vmcoreinfo supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <genid supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backingStoreInput supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <backup supported='yes'/>
Jul 31 12:06:47 user nova-compute[72447]:     <sev supported='no'/>
Jul 31 12:06:47 user nova-compute[72447]:   </features>
Jul 31 12:06:47 user nova-compute[72447]: </domainCapabilities>
Jul 31 12:06:47 user nova-compute[72447]:  {{(pid=72447) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72447) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72447) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Checking secure boot support for host arch (x86_64) {{(pid=72447) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 31 12:06:47 user nova-compute[72447]: INFO nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Secure Boot support detected
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] cpu compare xml: <cpu match="exact">
Jul 31 12:06:47 user nova-compute[72447]:   <model>Nehalem</model>
Jul 31 12:06:47 user nova-compute[72447]: </cpu>
Jul 31 12:06:47 user nova-compute[72447]:  {{(pid=72447) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 31 12:06:47 user nova-compute[72447]: INFO nova.virt.node [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Generated node identity b4624c66-2a39-4376-bf09-7f8bf9b99fc6
Jul 31 12:06:47 user nova-compute[72447]: INFO nova.virt.node [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Wrote node identity b4624c66-2a39-4376-bf09-7f8bf9b99fc6 to /opt/stack/data/nova/compute_id
Jul 31 12:06:47 user nova-compute[72447]: WARNING nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Compute nodes ['b4624c66-2a39-4376-bf09-7f8bf9b99fc6'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 31 12:06:47 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 31 12:06:47 user nova-compute[72447]: WARNING nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 31 12:06:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:06:47 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:06:47 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Hypervisor/Node resource view: name=user free_ram=10871MB free_disk=26.257469177246094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:06:47 user nova-compute[72447]: WARNING nova.compute.resource_tracker [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] No compute node record for user:b4624c66-2a39-4376-bf09-7f8bf9b99fc6: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b4624c66-2a39-4376-bf09-7f8bf9b99fc6 could not be found.
Jul 31 12:06:47 user nova-compute[72447]: INFO nova.compute.resource_tracker [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Compute node record created for user:user with uuid: b4624c66-2a39-4376-bf09-7f8bf9b99fc6
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:06:47 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:06:47 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [req-dd2731d9-bf5a-4105-a7ba-5fe1577a3824] Created resource provider record via placement API for resource provider with UUID b4624c66-2a39-4376-bf09-7f8bf9b99fc6 and name user.
Jul 31 12:06:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72447) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 31 12:06:48 user nova-compute[72447]: INFO nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] kernel doesn't support AMD SEV
Jul 31 12:06:48 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 12:06:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:06:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Libvirt baseline CPU <cpu>
Jul 31 12:06:48 user nova-compute[72447]:   <arch>x86_64</arch>
Jul 31 12:06:48 user nova-compute[72447]:   <model>Nehalem</model>
Jul 31 12:06:48 user nova-compute[72447]:   <vendor>Intel</vendor>
Jul 31 12:06:48 user nova-compute[72447]:   <topology sockets="6" cores="1" threads="1"/>
Jul 31 12:06:48 user nova-compute[72447]: </cpu>
Jul 31 12:06:48 user nova-compute[72447]:  {{(pid=72447) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 31 12:06:48 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Updated inventory for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 31 12:06:48 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Updating resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 generation from 0 to 1 during operation: update_inventory {{(pid=72447) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 31 12:06:48 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 12:06:48 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Updating resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 generation from 1 to 2 during operation: update_traits {{(pid=72447) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 31 12:06:48 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:06:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:06:48 user nova-compute[72447]: DEBUG nova.service [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Creating RPC server for service compute {{(pid=72447) start /opt/stack/nova/nova/service.py:182}}
Jul 31 12:06:48 user nova-compute[72447]: DEBUG nova.service [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Join ServiceGroup membership for this service compute {{(pid=72447) start /opt/stack/nova/nova/service.py:199}}
Jul 31 12:06:48 user nova-compute[72447]: DEBUG nova.servicegroup.drivers.db [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72447) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:07:46 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:07:46 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:07:46 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=10155MB free_disk=26.161334991455078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:07:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:08:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:08:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:08:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:08:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:08:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:08:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:08:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:08:39 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:08:40 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:08:40 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:08:40 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=10200MB free_disk=26.206710815429688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:08:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:08:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:08:40 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:08:40 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:08:40 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:08:40 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:08:40 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:08:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:08:40 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:08:40 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:08:40 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:08:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:08:41 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:08:41 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:08:41 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:08:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:08:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:08:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:09:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:09:40 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:09:40 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:09:40 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=10225MB free_disk=25.980480194091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:09:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:09:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:09:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:09:42 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:09:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:09:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:09:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:09:42 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:09:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:09:43 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:09:43 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:09:43 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:10:40 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:10:42 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:10:42 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:10:42 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=9437MB free_disk=26.00274658203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:10:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:43 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:10:43 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:10:43 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:10:43 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:10:43 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:10:45 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:10:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:10:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:51 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:10:51 user nova-compute[72447]: INFO nova.compute.claims [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Claim successful on node user
Jul 31 12:10:51 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:10:51 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:10:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:10:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:10:52 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:10:52 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:10:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:10:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:10:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:10:52 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Creating image(s)
Jul 31 12:10:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "/opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "/opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "/opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c.part --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:53 user nova-compute[72447]: DEBUG nova.policy [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbcdd571b45b4450a8b27b834a05a2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9576e1abb5b1475da061ca824d7c3788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:10:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c.part --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:53 user nova-compute[72447]: DEBUG nova.virt.images [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] e1118021-a8cd-4e2b-b5b6-62d0c4085b6e was qcow2, converting to raw {{(pid=72447) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 12:10:53 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:10:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c.part /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c.converted {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c.part /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c.converted" returned: 0 in 0.184s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c.converted --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.439s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:53 user nova-compute[72447]: INFO oslo.privsep.daemon [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbqr7kda4/privsep.sock']
Jul 31 12:10:53 user sudo[81588]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbqr7kda4/privsep.sock
Jul 31 12:10:53 user sudo[81588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 31 12:10:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:10:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:54 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:10:54 user nova-compute[72447]: INFO nova.compute.claims [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Claim successful on node user
Jul 31 12:10:54 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:10:54 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:10:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:10:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:10:54 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:10:54 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:10:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:10:55 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:10:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:10:55 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Creating image(s)
Jul 31 12:10:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "/opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "/opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "/opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:55 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Successfully created port: 845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:10:55 user nova-compute[72447]: DEBUG nova.policy [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbcdd571b45b4450a8b27b834a05a2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9576e1abb5b1475da061ca824d7c3788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:10:55 user sudo[81588]: pam_unix(sudo:session): session closed for user root
Jul 31 12:10:55 user nova-compute[72447]: INFO oslo.privsep.daemon [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Spawned new privsep daemon via rootwrap
Jul 31 12:10:55 user nova-compute[72447]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 12:10:55 user nova-compute[72447]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 12:10:55 user nova-compute[72447]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 31 12:10:55 user nova-compute[72447]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81597
Jul 31 12:10:55 user nova-compute[72447]: WARNING oslo_privsep.priv_context [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] privsep daemon already running
Jul 31 12:10:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.179s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.190s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.177s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk 1073741824" returned: 0 in 0.057s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.236s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.196s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.201s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk 1073741824" returned: 0 in 0.057s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Cannot resize image /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'migration_context' on Instance uuid 00c9825b-0cc3-4c07-87bf-bffaabe4c265 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Ensure instance console log exists: /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.176s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Checking if we can resize image /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Cannot resize image /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG nova.objects.instance [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'migration_context' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Ensure instance console log exists: /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:58 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Successfully updated port: 845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:10:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:10:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquired lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:10:58 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:10:58 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Successfully created port: 8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:10:58 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-df5dd49a-1057-4070-88b1-deb555d2ff53 req-cf834f18-6427-4af0-9217-beda3cefbb1b service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-changed-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-df5dd49a-1057-4070-88b1-deb555d2ff53 req-cf834f18-6427-4af0-9217-beda3cefbb1b service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Refreshing instance network info cache due to event network-changed-845d0677-fdf6-4de9-abc7-243080eeae50. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-df5dd49a-1057-4070-88b1-deb555d2ff53 req-cf834f18-6427-4af0-9217-beda3cefbb1b service nova] Acquiring lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:10:59 user nova-compute[72447]: INFO nova.compute.claims [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Claim successful on node user
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "6c701045-e520-421f-94d2-b54edd0d5c54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.compute.manager [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.040s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:10:59 user nova-compute[72447]: INFO nova.compute.claims [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Claim successful on node user
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:10:59 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updating instance_info_cache with network_info: [{"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Releasing lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Instance network_info: |[{"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-df5dd49a-1057-4070-88b1-deb555d2ff53 req-cf834f18-6427-4af0-9217-beda3cefbb1b service nova] Acquired lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.network.neutron [req-df5dd49a-1057-4070-88b1-deb555d2ff53 req-cf834f18-6427-4af0-9217-beda3cefbb1b service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Refreshing network info cache for port 845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Start _get_guest_xml network_info=[{"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:10:59 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:10:59 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2031996339',display_name='tempest-ServerRescueNegativeTestJSON-server-2031996339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2031996339',id=1,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9576e1abb5b1475da061ca824d7c3788',ramdisk_id='',reservation_id='r-dmkw01xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2103641702',owner_user_name='tempest-ServerRescueNegativeTestJSON-2103641702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:10:52Z,user_data=None,user_id='cbcdd571b45b4450a8b27b834a05a2b6',uuid=981b694a-bf63-4f4b-95c5-bc17aa72b87b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converting VIF {"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:66:ee,bridge_name='br-int',has_traffic_filtering=True,id=845d0677-fdf6-4de9-abc7-243080eeae50,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845d0677-fd') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.objects.instance [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'pci_devices' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:10:59 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Creating image(s)
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "/opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "/opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "/opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:10:59 user nova-compute[72447]:   <uuid>981b694a-bf63-4f4b-95c5-bc17aa72b87b</uuid>
Jul 31 12:10:59 user nova-compute[72447]:   <name>instance-00000001</name>
Jul 31 12:10:59 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:10:59 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:10:59 user nova-compute[72447]:   <metadata>
Jul 31 12:10:59 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:10:59 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:10:59 user nova-compute[72447]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2031996339</nova:name>
Jul 31 12:10:59 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:10:59</nova:creationTime>
Jul 31 12:10:59 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:10:59 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:10:59 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:10:59 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:10:59 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:10:59 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:10:59 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:10:59 user nova-compute[72447]:       <nova:owner>
Jul 31 12:10:59 user nova-compute[72447]:         <nova:user uuid="cbcdd571b45b4450a8b27b834a05a2b6">tempest-ServerRescueNegativeTestJSON-2103641702-project-member</nova:user>
Jul 31 12:10:59 user nova-compute[72447]:         <nova:project uuid="9576e1abb5b1475da061ca824d7c3788">tempest-ServerRescueNegativeTestJSON-2103641702</nova:project>
Jul 31 12:10:59 user nova-compute[72447]:       </nova:owner>
Jul 31 12:10:59 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:10:59 user nova-compute[72447]:       <nova:ports>
Jul 31 12:10:59 user nova-compute[72447]:         <nova:port uuid="845d0677-fdf6-4de9-abc7-243080eeae50">
Jul 31 12:10:59 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 12:10:59 user nova-compute[72447]:         </nova:port>
Jul 31 12:10:59 user nova-compute[72447]:       </nova:ports>
Jul 31 12:10:59 user nova-compute[72447]:     </nova:instance>
Jul 31 12:10:59 user nova-compute[72447]:   </metadata>
Jul 31 12:10:59 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:10:59 user nova-compute[72447]:     <system>
Jul 31 12:10:59 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:10:59 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:10:59 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:10:59 user nova-compute[72447]:       <entry name="serial">981b694a-bf63-4f4b-95c5-bc17aa72b87b</entry>
Jul 31 12:10:59 user nova-compute[72447]:       <entry name="uuid">981b694a-bf63-4f4b-95c5-bc17aa72b87b</entry>
Jul 31 12:10:59 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:10:59 user nova-compute[72447]:     </system>
Jul 31 12:10:59 user nova-compute[72447]:   </sysinfo>
Jul 31 12:10:59 user nova-compute[72447]:   <os>
Jul 31 12:10:59 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:10:59 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:10:59 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:10:59 user nova-compute[72447]:   </os>
Jul 31 12:10:59 user nova-compute[72447]:   <features>
Jul 31 12:10:59 user nova-compute[72447]:     <acpi/>
Jul 31 12:10:59 user nova-compute[72447]:     <apic/>
Jul 31 12:10:59 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:10:59 user nova-compute[72447]:   </features>
Jul 31 12:10:59 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:10:59 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:10:59 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:10:59 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:10:59 user nova-compute[72447]:   </clock>
Jul 31 12:10:59 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:10:59 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:10:59 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:10:59 user nova-compute[72447]:   </cpu>
Jul 31 12:10:59 user nova-compute[72447]:   <devices>
Jul 31 12:10:59 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:10:59 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:10:59 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk"/>
Jul 31 12:10:59 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:10:59 user nova-compute[72447]:     </disk>
Jul 31 12:10:59 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:10:59 user nova-compute[72447]:       <mac address="fa:16:3e:cf:66:ee"/>
Jul 31 12:10:59 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:10:59 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:10:59 user nova-compute[72447]:       <target dev="tap845d0677-fd"/>
Jul 31 12:10:59 user nova-compute[72447]:     </interface>
Jul 31 12:10:59 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:10:59 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/console.log" append="off"/>
Jul 31 12:10:59 user nova-compute[72447]:     </serial>
Jul 31 12:10:59 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:10:59 user nova-compute[72447]:     <video>
Jul 31 12:10:59 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:10:59 user nova-compute[72447]:     </video>
Jul 31 12:10:59 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:10:59 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:10:59 user nova-compute[72447]:     </rng>
Jul 31 12:10:59 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:10:59 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:10:59 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:10:59 user nova-compute[72447]:     </memballoon>
Jul 31 12:10:59 user nova-compute[72447]:   </devices>
Jul 31 12:10:59 user nova-compute[72447]: </domain>
Jul 31 12:10:59 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2031996339',display_name='tempest-ServerRescueNegativeTestJSON-server-2031996339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2031996339',id=1,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9576e1abb5b1475da061ca824d7c3788',ramdisk_id='',reservation_id='r-dmkw01xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2103641702',owner_user_name='tempest-ServerRescueNegativeTestJSON-2103641702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:10:52Z,user_data=None,user_id='cbcdd571b45b4450a8b27b834a05a2b6',uuid=981b694a-bf63-4f4b-95c5-bc17aa72b87b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converting VIF {"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:66:ee,bridge_name='br-int',has_traffic_filtering=True,id=845d0677-fdf6-4de9-abc7-243080eeae50,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845d0677-fd') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG os_vif [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:66:ee,bridge_name='br-int',has_traffic_filtering=True,id=845d0677-fdf6-4de9-abc7-243080eeae50,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845d0677-fd') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:10:59 user nova-compute[72447]: DEBUG nova.policy [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de2fa3b70ec747628afaf3c707e6d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139411ad75fe4bdf9e858f4260dfa1c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Created schema index Interface.name {{(pid=72447) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Created schema index Port.name {{(pid=72447) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Created schema index Bridge.name {{(pid=72447) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [POLLOUT] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.182s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:00 user nova-compute[72447]: INFO oslo.privsep.daemon [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpszahm_pc/privsep.sock']
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:11:00 user sudo[81649]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpszahm_pc/privsep.sock
Jul 31 12:11:00 user sudo[81649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk 1073741824" returned: 0 in 0.084s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.network.neutron [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:11:00 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Cannot resize image /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'migration_context' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Ensure instance console log exists: /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:11:00 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Creating image(s)
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "/opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "/opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG nova.policy [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc465160a3a94498ab1aa3aa44280b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8dd0d543cb4786afc39e88f440e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk 1073741824" returned: 0 in 0.077s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Cannot resize image /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG nova.objects.instance [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'migration_context' on Instance uuid 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Ensure instance console log exists: /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG nova.network.neutron [req-df5dd49a-1057-4070-88b1-deb555d2ff53 req-cf834f18-6427-4af0-9217-beda3cefbb1b service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updated VIF entry in instance network info cache for port 845d0677-fdf6-4de9-abc7-243080eeae50. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG nova.network.neutron [req-df5dd49a-1057-4070-88b1-deb555d2ff53 req-cf834f18-6427-4af0-9217-beda3cefbb1b service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updating instance_info_cache with network_info: [{"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-df5dd49a-1057-4070-88b1-deb555d2ff53 req-cf834f18-6427-4af0-9217-beda3cefbb1b service nova] Releasing lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "ba0c6dba-0035-4196-a05f-9335436fac86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "ba0c6dba-0035-4196-a05f-9335436fac86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:01 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:11:01 user nova-compute[72447]: INFO nova.compute.claims [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Claim successful on node user
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:11:02 user sudo[81649]: pam_unix(sudo:session): session closed for user root
Jul 31 12:11:02 user nova-compute[72447]: INFO oslo.privsep.daemon [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Spawned new privsep daemon via rootwrap
Jul 31 12:11:02 user nova-compute[72447]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 12:11:02 user nova-compute[72447]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 12:11:02 user nova-compute[72447]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 31 12:11:02 user nova-compute[72447]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81674
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.compute.manager [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Successfully updated port: 8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquired lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.compute.manager [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.network.neutron [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:11:02 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.compute.manager [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.compute.manager [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:11:02 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Creating image(s)
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "/opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "/opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.policy [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a7feffde0f74f63a6bd027c1958aacb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fad40b5f5e54e7ab9c6f8e78ceb3947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-83e474a8-fafc-4620-9e73-b67a79497e59 req-ee6b1c1a-4063-404a-a4d0-412b8279899b service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received event network-changed-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-83e474a8-fafc-4620-9e73-b67a79497e59 req-ee6b1c1a-4063-404a-a4d0-412b8279899b service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Refreshing instance network info cache due to event network-changed-8e631d77-6caf-4106-8a95-8f90c2e6417d. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-83e474a8-fafc-4620-9e73-b67a79497e59 req-ee6b1c1a-4063-404a-a4d0-412b8279899b service nova] Acquiring lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap845d0677-fd, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap845d0677-fd, col_values=(('external_ids', {'iface-id': '845d0677-fdf6-4de9-abc7-243080eeae50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:66:ee', 'vm-uuid': '981b694a-bf63-4f4b-95c5-bc17aa72b87b'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:02 user nova-compute[72447]: INFO os_vif [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:66:ee,bridge_name='br-int',has_traffic_filtering=True,id=845d0677-fdf6-4de9-abc7-243080eeae50,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845d0677-fd')
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk 1073741824" returned: 0 in 0.055s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No VIF found with MAC fa:16:3e:cf:66:ee, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Updating instance_info_cache with network_info: [{"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Successfully created port: f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Releasing lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Instance network_info: |[{"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-83e474a8-fafc-4620-9e73-b67a79497e59 req-ee6b1c1a-4063-404a-a4d0-412b8279899b service nova] Acquired lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.network.neutron [req-83e474a8-fafc-4620-9e73-b67a79497e59 req-ee6b1c1a-4063-404a-a4d0-412b8279899b service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Refreshing network info cache for port 8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Start _get_guest_xml network_info=[{"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:11:02 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:02 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.125s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:11:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-126637251',display_name='tempest-ServerRescueNegativeTestJSON-server-126637251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-126637251',id=2,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9576e1abb5b1475da061ca824d7c3788',ramdisk_id='',reservation_id='r-upw6bz0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2103641702',owner_user_name='tempest-ServerRescueNegativeTestJSON-2103641702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:10:55Z,user_data=None,user_id='cbcdd571b45b4450a8b27b834a05a2b6',uuid=00c9825b-0cc3-4c07-87bf-bffaabe4c265,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converting VIF {"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e3:9f,bridge_name='br-int',has_traffic_filtering=True,id=8e631d77-6caf-4106-8a95-8f90c2e6417d,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e631d77-6c') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'pci_devices' on Instance uuid 00c9825b-0cc3-4c07-87bf-bffaabe4c265 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:11:03 user nova-compute[72447]:   <uuid>00c9825b-0cc3-4c07-87bf-bffaabe4c265</uuid>
Jul 31 12:11:03 user nova-compute[72447]:   <name>instance-00000002</name>
Jul 31 12:11:03 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:11:03 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:11:03 user nova-compute[72447]:   <metadata>
Jul 31 12:11:03 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:11:03 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:11:03 user nova-compute[72447]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-126637251</nova:name>
Jul 31 12:11:03 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:11:02</nova:creationTime>
Jul 31 12:11:03 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:11:03 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:11:03 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:11:03 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:11:03 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:11:03 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:11:03 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:11:03 user nova-compute[72447]:       <nova:owner>
Jul 31 12:11:03 user nova-compute[72447]:         <nova:user uuid="cbcdd571b45b4450a8b27b834a05a2b6">tempest-ServerRescueNegativeTestJSON-2103641702-project-member</nova:user>
Jul 31 12:11:03 user nova-compute[72447]:         <nova:project uuid="9576e1abb5b1475da061ca824d7c3788">tempest-ServerRescueNegativeTestJSON-2103641702</nova:project>
Jul 31 12:11:03 user nova-compute[72447]:       </nova:owner>
Jul 31 12:11:03 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:11:03 user nova-compute[72447]:       <nova:ports>
Jul 31 12:11:03 user nova-compute[72447]:         <nova:port uuid="8e631d77-6caf-4106-8a95-8f90c2e6417d">
Jul 31 12:11:03 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 12:11:03 user nova-compute[72447]:         </nova:port>
Jul 31 12:11:03 user nova-compute[72447]:       </nova:ports>
Jul 31 12:11:03 user nova-compute[72447]:     </nova:instance>
Jul 31 12:11:03 user nova-compute[72447]:   </metadata>
Jul 31 12:11:03 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:11:03 user nova-compute[72447]:     <system>
Jul 31 12:11:03 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:11:03 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:11:03 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:11:03 user nova-compute[72447]:       <entry name="serial">00c9825b-0cc3-4c07-87bf-bffaabe4c265</entry>
Jul 31 12:11:03 user nova-compute[72447]:       <entry name="uuid">00c9825b-0cc3-4c07-87bf-bffaabe4c265</entry>
Jul 31 12:11:03 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:11:03 user nova-compute[72447]:     </system>
Jul 31 12:11:03 user nova-compute[72447]:   </sysinfo>
Jul 31 12:11:03 user nova-compute[72447]:   <os>
Jul 31 12:11:03 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:11:03 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:11:03 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:11:03 user nova-compute[72447]:   </os>
Jul 31 12:11:03 user nova-compute[72447]:   <features>
Jul 31 12:11:03 user nova-compute[72447]:     <acpi/>
Jul 31 12:11:03 user nova-compute[72447]:     <apic/>
Jul 31 12:11:03 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:11:03 user nova-compute[72447]:   </features>
Jul 31 12:11:03 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:11:03 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:11:03 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:11:03 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:11:03 user nova-compute[72447]:   </clock>
Jul 31 12:11:03 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:11:03 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:11:03 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:11:03 user nova-compute[72447]:   </cpu>
Jul 31 12:11:03 user nova-compute[72447]:   <devices>
Jul 31 12:11:03 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:11:03 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:11:03 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk"/>
Jul 31 12:11:03 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:11:03 user nova-compute[72447]:     </disk>
Jul 31 12:11:03 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:11:03 user nova-compute[72447]:       <mac address="fa:16:3e:8f:e3:9f"/>
Jul 31 12:11:03 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:03 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:11:03 user nova-compute[72447]:       <target dev="tap8e631d77-6c"/>
Jul 31 12:11:03 user nova-compute[72447]:     </interface>
Jul 31 12:11:03 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:11:03 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/console.log" append="off"/>
Jul 31 12:11:03 user nova-compute[72447]:     </serial>
Jul 31 12:11:03 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:11:03 user nova-compute[72447]:     <video>
Jul 31 12:11:03 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:03 user nova-compute[72447]:     </video>
Jul 31 12:11:03 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:11:03 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:11:03 user nova-compute[72447]:     </rng>
Jul 31 12:11:03 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:11:03 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:11:03 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:11:03 user nova-compute[72447]:     </memballoon>
Jul 31 12:11:03 user nova-compute[72447]:   </devices>
Jul 31 12:11:03 user nova-compute[72447]: </domain>
Jul 31 12:11:03 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-126637251',display_name='tempest-ServerRescueNegativeTestJSON-server-126637251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-126637251',id=2,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9576e1abb5b1475da061ca824d7c3788',ramdisk_id='',reservation_id='r-upw6bz0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2103641702',owner_user_name='tempest-ServerRescueNegativeTestJSON-2103641702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:10:55Z,user_data=None,user_id='cbcdd571b45b4450a8b27b834a05a2b6',uuid=00c9825b-0cc3-4c07-87bf-bffaabe4c265,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converting VIF {"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e3:9f,bridge_name='br-int',has_traffic_filtering=True,id=8e631d77-6caf-4106-8a95-8f90c2e6417d,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e631d77-6c') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG os_vif [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e3:9f,bridge_name='br-int',has_traffic_filtering=True,id=8e631d77-6caf-4106-8a95-8f90c2e6417d,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e631d77-6c') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e631d77-6c, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e631d77-6c, col_values=(('external_ids', {'iface-id': '8e631d77-6caf-4106-8a95-8f90c2e6417d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:e3:9f', 'vm-uuid': '00c9825b-0cc3-4c07-87bf-bffaabe4c265'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:03 user nova-compute[72447]: INFO os_vif [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e3:9f,bridge_name='br-int',has_traffic_filtering=True,id=8e631d77-6caf-4106-8a95-8f90c2e6417d,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e631d77-6c')
Jul 31 12:11:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Cannot resize image /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'migration_context' on Instance uuid ba0c6dba-0035-4196-a05f-9335436fac86 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Ensure instance console log exists: /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No VIF found with MAC fa:16:3e:8f:e3:9f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.network.neutron [req-83e474a8-fafc-4620-9e73-b67a79497e59 req-ee6b1c1a-4063-404a-a4d0-412b8279899b service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Updated VIF entry in instance network info cache for port 8e631d77-6caf-4106-8a95-8f90c2e6417d. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.network.neutron [req-83e474a8-fafc-4620-9e73-b67a79497e59 req-ee6b1c1a-4063-404a-a4d0-412b8279899b service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Updating instance_info_cache with network_info: [{"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG nova.network.neutron [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Successfully created port: c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:11:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-83e474a8-fafc-4620-9e73-b67a79497e59 req-ee6b1c1a-4063-404a-a4d0-412b8279899b service nova] Releasing lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Successfully created port: 9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:11:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Successfully updated port: f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:11:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquired lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:11:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-f74db496-0c97-4f0e-b8e7-a037e1ccab11 req-cef57e66-f9dc-4005-b6c6-17900568839e service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f74db496-0c97-4f0e-b8e7-a037e1ccab11 req-cef57e66-f9dc-4005-b6c6-17900568839e service nova] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f74db496-0c97-4f0e-b8e7-a037e1ccab11 req-cef57e66-f9dc-4005-b6c6-17900568839e service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f74db496-0c97-4f0e-b8e7-a037e1ccab11 req-cef57e66-f9dc-4005-b6c6-17900568839e service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-f74db496-0c97-4f0e-b8e7-a037e1ccab11 req-cef57e66-f9dc-4005-b6c6-17900568839e service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] No waiting events found dispatching network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:06 user nova-compute[72447]: WARNING nova.compute.manager [req-f74db496-0c97-4f0e-b8e7-a037e1ccab11 req-cef57e66-f9dc-4005-b6c6-17900568839e service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received unexpected event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 for instance with vm_state building and task_state spawning.
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-376580ef-5093-41c4-97b7-64025e3a28ea req-1a9168b2-16c4-4227-8e66-275de0dea131 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-changed-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-376580ef-5093-41c4-97b7-64025e3a28ea req-1a9168b2-16c4-4227-8e66-275de0dea131 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Refreshing instance network info cache due to event network-changed-f276935a-5cfd-4a23-a87e-cbab33adf21e. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-376580ef-5093-41c4-97b7-64025e3a28ea req-1a9168b2-16c4-4227-8e66-275de0dea131 service nova] Acquiring lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805467.606813, 981b694a-bf63-4f4b-95c5-bc17aa72b87b => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] VM Resumed (Lifecycle Event)
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Instance spawned successfully.
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Instance spawned successfully.
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805467.6137733, 981b694a-bf63-4f4b-95c5-bc17aa72b87b => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] VM Started (Lifecycle Event)
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.compute.manager [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Took 15.51 seconds to spawn the instance on the hypervisor.
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.compute.manager [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Took 12.71 seconds to spawn the instance on the hypervisor.
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805467.6802986, 00c9825b-0cc3-4c07-87bf-bffaabe4c265 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] VM Resumed (Lifecycle Event)
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.compute.manager [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Took 16.48 seconds to build instance.
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805467.6806822, 00c9825b-0cc3-4c07-87bf-bffaabe4c265 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] VM Started (Lifecycle Event)
Jul 31 12:11:07 user nova-compute[72447]: INFO nova.compute.manager [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Took 13.46 seconds to build instance.
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff8a6d72-b11a-414c-b985-0ced2f133d27 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.710s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c22b87c-527c-4c0d-a46c-baf8da5bf13d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.601s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updating instance_info_cache with network_info: [{"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.network.neutron [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Successfully updated port: c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquired lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.network.neutron [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Releasing lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Instance network_info: |[{"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-376580ef-5093-41c4-97b7-64025e3a28ea req-1a9168b2-16c4-4227-8e66-275de0dea131 service nova] Acquired lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.network.neutron [req-376580ef-5093-41c4-97b7-64025e3a28ea req-1a9168b2-16c4-4227-8e66-275de0dea131 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Refreshing network info cache for port f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Start _get_guest_xml network_info=[{"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:11:08 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:08 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1381244369',display_name='tempest-ServerStableDeviceRescueTest-server-1381244369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1381244369',id=3,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1icZEpEEW/JxHuc33dr3gmsa/8MvvGYu3d89THxX8AOljRfbuMkiO1Klj1CI/oe8u3BcZwF6qZ2IQZEO3QiveEPEKjXw2X6F9Kqdh3YeZyF3J6aXC148RMxGv+f4OePw==',key_name='tempest-keypair-406421083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='139411ad75fe4bdf9e858f4260dfa1c9',ramdisk_id='',reservation_id='r-ss8iel63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1013716252',owner_user_name='tempest-ServerStableDeviceRescueTest-1013716252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de2fa3b70ec747628afaf3c707e6d5ca',uuid=87bc8e3c-6a96-4466-b6c0-390ba3f662a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Converting VIF {"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:43:3e,bridge_name='br-int',has_traffic_filtering=True,id=f276935a-5cfd-4a23-a87e-cbab33adf21e,network=Network(8876bd0f-8dd8-4fc8-bb2d-98c58e43afec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf276935a-5c') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'pci_devices' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:11:08 user nova-compute[72447]:   <uuid>87bc8e3c-6a96-4466-b6c0-390ba3f662a4</uuid>
Jul 31 12:11:08 user nova-compute[72447]:   <name>instance-00000003</name>
Jul 31 12:11:08 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:11:08 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:11:08 user nova-compute[72447]:   <metadata>
Jul 31 12:11:08 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:11:08 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:11:08 user nova-compute[72447]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1381244369</nova:name>
Jul 31 12:11:08 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:11:08</nova:creationTime>
Jul 31 12:11:08 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:11:08 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:11:08 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:11:08 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:11:08 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:11:08 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:11:08 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:11:08 user nova-compute[72447]:       <nova:owner>
Jul 31 12:11:08 user nova-compute[72447]:         <nova:user uuid="de2fa3b70ec747628afaf3c707e6d5ca">tempest-ServerStableDeviceRescueTest-1013716252-project-member</nova:user>
Jul 31 12:11:08 user nova-compute[72447]:         <nova:project uuid="139411ad75fe4bdf9e858f4260dfa1c9">tempest-ServerStableDeviceRescueTest-1013716252</nova:project>
Jul 31 12:11:08 user nova-compute[72447]:       </nova:owner>
Jul 31 12:11:08 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:11:08 user nova-compute[72447]:       <nova:ports>
Jul 31 12:11:08 user nova-compute[72447]:         <nova:port uuid="f276935a-5cfd-4a23-a87e-cbab33adf21e">
Jul 31 12:11:08 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 12:11:08 user nova-compute[72447]:         </nova:port>
Jul 31 12:11:08 user nova-compute[72447]:       </nova:ports>
Jul 31 12:11:08 user nova-compute[72447]:     </nova:instance>
Jul 31 12:11:08 user nova-compute[72447]:   </metadata>
Jul 31 12:11:08 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:11:08 user nova-compute[72447]:     <system>
Jul 31 12:11:08 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:11:08 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:11:08 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:11:08 user nova-compute[72447]:       <entry name="serial">87bc8e3c-6a96-4466-b6c0-390ba3f662a4</entry>
Jul 31 12:11:08 user nova-compute[72447]:       <entry name="uuid">87bc8e3c-6a96-4466-b6c0-390ba3f662a4</entry>
Jul 31 12:11:08 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:11:08 user nova-compute[72447]:     </system>
Jul 31 12:11:08 user nova-compute[72447]:   </sysinfo>
Jul 31 12:11:08 user nova-compute[72447]:   <os>
Jul 31 12:11:08 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:11:08 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:11:08 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:11:08 user nova-compute[72447]:   </os>
Jul 31 12:11:08 user nova-compute[72447]:   <features>
Jul 31 12:11:08 user nova-compute[72447]:     <acpi/>
Jul 31 12:11:08 user nova-compute[72447]:     <apic/>
Jul 31 12:11:08 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:11:08 user nova-compute[72447]:   </features>
Jul 31 12:11:08 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:11:08 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:11:08 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:11:08 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:11:08 user nova-compute[72447]:   </clock>
Jul 31 12:11:08 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:11:08 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:11:08 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:11:08 user nova-compute[72447]:   </cpu>
Jul 31 12:11:08 user nova-compute[72447]:   <devices>
Jul 31 12:11:08 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:11:08 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:11:08 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk"/>
Jul 31 12:11:08 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:11:08 user nova-compute[72447]:     </disk>
Jul 31 12:11:08 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:11:08 user nova-compute[72447]:       <mac address="fa:16:3e:d4:43:3e"/>
Jul 31 12:11:08 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:08 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:11:08 user nova-compute[72447]:       <target dev="tapf276935a-5c"/>
Jul 31 12:11:08 user nova-compute[72447]:     </interface>
Jul 31 12:11:08 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:11:08 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/console.log" append="off"/>
Jul 31 12:11:08 user nova-compute[72447]:     </serial>
Jul 31 12:11:08 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:11:08 user nova-compute[72447]:     <video>
Jul 31 12:11:08 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:08 user nova-compute[72447]:     </video>
Jul 31 12:11:08 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:11:08 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:11:08 user nova-compute[72447]:     </rng>
Jul 31 12:11:08 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:11:08 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:11:08 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:11:08 user nova-compute[72447]:     </memballoon>
Jul 31 12:11:08 user nova-compute[72447]:   </devices>
Jul 31 12:11:08 user nova-compute[72447]: </domain>
Jul 31 12:11:08 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1381244369',display_name='tempest-ServerStableDeviceRescueTest-server-1381244369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1381244369',id=3,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1icZEpEEW/JxHuc33dr3gmsa/8MvvGYu3d89THxX8AOljRfbuMkiO1Klj1CI/oe8u3BcZwF6qZ2IQZEO3QiveEPEKjXw2X6F9Kqdh3YeZyF3J6aXC148RMxGv+f4OePw==',key_name='tempest-keypair-406421083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='139411ad75fe4bdf9e858f4260dfa1c9',ramdisk_id='',reservation_id='r-ss8iel63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1013716252',owner_user_name='tempest-ServerStableDeviceRescueTest-1013716252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de2fa3b70ec747628afaf3c707e6d5ca',uuid=87bc8e3c-6a96-4466-b6c0-390ba3f662a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Converting VIF {"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:43:3e,bridge_name='br-int',has_traffic_filtering=True,id=f276935a-5cfd-4a23-a87e-cbab33adf21e,network=Network(8876bd0f-8dd8-4fc8-bb2d-98c58e43afec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf276935a-5c') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG os_vif [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:43:3e,bridge_name='br-int',has_traffic_filtering=True,id=f276935a-5cfd-4a23-a87e-cbab33adf21e,network=Network(8876bd0f-8dd8-4fc8-bb2d-98c58e43afec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf276935a-5c') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.network.neutron [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf276935a-5c, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf276935a-5c, col_values=(('external_ids', {'iface-id': 'f276935a-5cfd-4a23-a87e-cbab33adf21e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:43:3e', 'vm-uuid': '87bc8e3c-6a96-4466-b6c0-390ba3f662a4'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:08 user nova-compute[72447]: INFO os_vif [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:43:3e,bridge_name='br-int',has_traffic_filtering=True,id=f276935a-5cfd-4a23-a87e-cbab33adf21e,network=Network(8876bd0f-8dd8-4fc8-bb2d-98c58e43afec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf276935a-5c')
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] No VIF found with MAC fa:16:3e:d4:43:3e, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:11:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-258948e1-ad1d-40c8-99db-33b184fac958 req-ac7a152e-f094-4e66-8be0-6b9e7884c866 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-258948e1-ad1d-40c8-99db-33b184fac958 req-ac7a152e-f094-4e66-8be0-6b9e7884c866 service nova] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-258948e1-ad1d-40c8-99db-33b184fac958 req-ac7a152e-f094-4e66-8be0-6b9e7884c866 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-258948e1-ad1d-40c8-99db-33b184fac958 req-ac7a152e-f094-4e66-8be0-6b9e7884c866 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-258948e1-ad1d-40c8-99db-33b184fac958 req-ac7a152e-f094-4e66-8be0-6b9e7884c866 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] No waiting events found dispatching network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:09 user nova-compute[72447]: WARNING nova.compute.manager [req-258948e1-ad1d-40c8-99db-33b184fac958 req-ac7a152e-f094-4e66-8be0-6b9e7884c866 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received unexpected event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 for instance with vm_state active and task_state None.
Jul 31 12:11:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received event network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] Acquiring lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] No waiting events found dispatching network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:09 user nova-compute[72447]: WARNING nova.compute.manager [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received unexpected event network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d for instance with vm_state active and task_state None.
Jul 31 12:11:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-changed-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Refreshing instance network info cache due to event network-changed-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] Acquiring lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG nova.network.neutron [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Successfully updated port: 9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "refresh_cache-ba0c6dba-0035-4196-a05f-9335436fac86" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquired lock "refresh_cache-ba0c6dba-0035-4196-a05f-9335436fac86" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG nova.network.neutron [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-37b7b34e-0efe-44ef-8df3-86a7d6663d12 req-f87d3bb5-7892-4606-88a5-7fe31f0da808 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Received event network-changed-9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-37b7b34e-0efe-44ef-8df3-86a7d6663d12 req-f87d3bb5-7892-4606-88a5-7fe31f0da808 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Refreshing instance network info cache due to event network-changed-9bc7922e-33db-4822-a9b9-497abe3fb078. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37b7b34e-0efe-44ef-8df3-86a7d6663d12 req-f87d3bb5-7892-4606-88a5-7fe31f0da808 service nova] Acquiring lock "refresh_cache-ba0c6dba-0035-4196-a05f-9335436fac86" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:09 user nova-compute[72447]: DEBUG nova.network.neutron [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:11:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:10 user nova-compute[72447]: DEBUG nova.network.neutron [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updating instance_info_cache with network_info: [{"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Releasing lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Instance network_info: |[{"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] Acquired lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.neutron [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Refreshing network info cache for port c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Start _get_guest_xml network_info=[{"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:11:11 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:11 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-15178390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-15178390',id=4,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYYPDRHR/gPH/ucT2yXGxpVxqTbPkE2g5ngdBqVVsQXRneiTQFTLKkxDWNoAHE8HulKOLnLKDCHYFWeNIt2FIxpmf8uOCr26dtrpZLq/BxGNXnJIbfPwJnHwEHuDQ42NQ==',key_name='tempest-keypair-2138130535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8dd0d543cb4786afc39e88f440e538',ramdisk_id='',reservation_id='r-e7ubc06s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1971436108',owner_user_name='tempest-AttachVolumeShelveTestJSON-1971436108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc465160a3a94498ab1aa3aa44280b12',uuid=6c701045-e520-421f-94d2-b54edd0d5c54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converting VIF {"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.objects.instance [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:11:11 user nova-compute[72447]:   <uuid>6c701045-e520-421f-94d2-b54edd0d5c54</uuid>
Jul 31 12:11:11 user nova-compute[72447]:   <name>instance-00000004</name>
Jul 31 12:11:11 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:11:11 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:11:11 user nova-compute[72447]:   <metadata>
Jul 31 12:11:11 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:11:11 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:11:11 user nova-compute[72447]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-15178390</nova:name>
Jul 31 12:11:11 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:11:11</nova:creationTime>
Jul 31 12:11:11 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:11:11 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:11:11 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:11:11 user nova-compute[72447]:       <nova:owner>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:user uuid="cc465160a3a94498ab1aa3aa44280b12">tempest-AttachVolumeShelveTestJSON-1971436108-project-member</nova:user>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:project uuid="8b8dd0d543cb4786afc39e88f440e538">tempest-AttachVolumeShelveTestJSON-1971436108</nova:project>
Jul 31 12:11:11 user nova-compute[72447]:       </nova:owner>
Jul 31 12:11:11 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:11:11 user nova-compute[72447]:       <nova:ports>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:port uuid="c9c41aee-bb54-4d97-8f69-9dd65e2c97b7">
Jul 31 12:11:11 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 12:11:11 user nova-compute[72447]:         </nova:port>
Jul 31 12:11:11 user nova-compute[72447]:       </nova:ports>
Jul 31 12:11:11 user nova-compute[72447]:     </nova:instance>
Jul 31 12:11:11 user nova-compute[72447]:   </metadata>
Jul 31 12:11:11 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:11:11 user nova-compute[72447]:     <system>
Jul 31 12:11:11 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:11:11 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:11:11 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:11:11 user nova-compute[72447]:       <entry name="serial">6c701045-e520-421f-94d2-b54edd0d5c54</entry>
Jul 31 12:11:11 user nova-compute[72447]:       <entry name="uuid">6c701045-e520-421f-94d2-b54edd0d5c54</entry>
Jul 31 12:11:11 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:11:11 user nova-compute[72447]:     </system>
Jul 31 12:11:11 user nova-compute[72447]:   </sysinfo>
Jul 31 12:11:11 user nova-compute[72447]:   <os>
Jul 31 12:11:11 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:11:11 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:11:11 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:11:11 user nova-compute[72447]:   </os>
Jul 31 12:11:11 user nova-compute[72447]:   <features>
Jul 31 12:11:11 user nova-compute[72447]:     <acpi/>
Jul 31 12:11:11 user nova-compute[72447]:     <apic/>
Jul 31 12:11:11 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:11:11 user nova-compute[72447]:   </features>
Jul 31 12:11:11 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:11:11 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:11:11 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:11:11 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:11:11 user nova-compute[72447]:   </clock>
Jul 31 12:11:11 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:11:11 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:11:11 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:11:11 user nova-compute[72447]:   </cpu>
Jul 31 12:11:11 user nova-compute[72447]:   <devices>
Jul 31 12:11:11 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:11:11 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:11:11 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk"/>
Jul 31 12:11:11 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:11:11 user nova-compute[72447]:     </disk>
Jul 31 12:11:11 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:11:11 user nova-compute[72447]:       <mac address="fa:16:3e:71:0e:50"/>
Jul 31 12:11:11 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:11 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:11:11 user nova-compute[72447]:       <target dev="tapc9c41aee-bb"/>
Jul 31 12:11:11 user nova-compute[72447]:     </interface>
Jul 31 12:11:11 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:11:11 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/console.log" append="off"/>
Jul 31 12:11:11 user nova-compute[72447]:     </serial>
Jul 31 12:11:11 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:11:11 user nova-compute[72447]:     <video>
Jul 31 12:11:11 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:11 user nova-compute[72447]:     </video>
Jul 31 12:11:11 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:11:11 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:11:11 user nova-compute[72447]:     </rng>
Jul 31 12:11:11 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:11:11 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:11:11 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:11:11 user nova-compute[72447]:     </memballoon>
Jul 31 12:11:11 user nova-compute[72447]:   </devices>
Jul 31 12:11:11 user nova-compute[72447]: </domain>
Jul 31 12:11:11 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-15178390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-15178390',id=4,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYYPDRHR/gPH/ucT2yXGxpVxqTbPkE2g5ngdBqVVsQXRneiTQFTLKkxDWNoAHE8HulKOLnLKDCHYFWeNIt2FIxpmf8uOCr26dtrpZLq/BxGNXnJIbfPwJnHwEHuDQ42NQ==',key_name='tempest-keypair-2138130535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8dd0d543cb4786afc39e88f440e538',ramdisk_id='',reservation_id='r-e7ubc06s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1971436108',owner_user_name='tempest-AttachVolumeShelveTestJSON-1971436108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc465160a3a94498ab1aa3aa44280b12',uuid=6c701045-e520-421f-94d2-b54edd0d5c54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converting VIF {"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG os_vif [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.neutron [req-376580ef-5093-41c4-97b7-64025e3a28ea req-1a9168b2-16c4-4227-8e66-275de0dea131 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updated VIF entry in instance network info cache for port f276935a-5cfd-4a23-a87e-cbab33adf21e. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.neutron [req-376580ef-5093-41c4-97b7-64025e3a28ea req-1a9168b2-16c4-4227-8e66-275de0dea131 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updating instance_info_cache with network_info: [{"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9c41aee-bb, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9c41aee-bb, col_values=(('external_ids', {'iface-id': 'c9c41aee-bb54-4d97-8f69-9dd65e2c97b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:0e:50', 'vm-uuid': '6c701045-e520-421f-94d2-b54edd0d5c54'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-376580ef-5093-41c4-97b7-64025e3a28ea req-1a9168b2-16c4-4227-8e66-275de0dea131 service nova] Releasing lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:11 user nova-compute[72447]: INFO os_vif [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb')
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] No VIF found with MAC fa:16:3e:71:0e:50, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-3987e560-a06e-4a7b-aa07-f5c8ae6d0398 req-cc02534a-4f12-40ba-a31d-c6e4f4c36d61 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received event network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3987e560-a06e-4a7b-aa07-f5c8ae6d0398 req-cc02534a-4f12-40ba-a31d-c6e4f4c36d61 service nova] Acquiring lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3987e560-a06e-4a7b-aa07-f5c8ae6d0398 req-cc02534a-4f12-40ba-a31d-c6e4f4c36d61 service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3987e560-a06e-4a7b-aa07-f5c8ae6d0398 req-cc02534a-4f12-40ba-a31d-c6e4f4c36d61 service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-3987e560-a06e-4a7b-aa07-f5c8ae6d0398 req-cc02534a-4f12-40ba-a31d-c6e4f4c36d61 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] No waiting events found dispatching network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:11 user nova-compute[72447]: WARNING nova.compute.manager [req-3987e560-a06e-4a7b-aa07-f5c8ae6d0398 req-cc02534a-4f12-40ba-a31d-c6e4f4c36d61 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received unexpected event network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d for instance with vm_state active and task_state None.
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.neutron [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Updating instance_info_cache with network_info: [{"id": "9bc7922e-33db-4822-a9b9-497abe3fb078", "address": "fa:16:3e:62:fc:84", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc7922e-33", "ovs_interfaceid": "9bc7922e-33db-4822-a9b9-497abe3fb078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Releasing lock "refresh_cache-ba0c6dba-0035-4196-a05f-9335436fac86" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Instance network_info: |[{"id": "9bc7922e-33db-4822-a9b9-497abe3fb078", "address": "fa:16:3e:62:fc:84", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc7922e-33", "ovs_interfaceid": "9bc7922e-33db-4822-a9b9-497abe3fb078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37b7b34e-0efe-44ef-8df3-86a7d6663d12 req-f87d3bb5-7892-4606-88a5-7fe31f0da808 service nova] Acquired lock "refresh_cache-ba0c6dba-0035-4196-a05f-9335436fac86" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.neutron [req-37b7b34e-0efe-44ef-8df3-86a7d6663d12 req-f87d3bb5-7892-4606-88a5-7fe31f0da808 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Refreshing network info cache for port 9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Start _get_guest_xml network_info=[{"id": "9bc7922e-33db-4822-a9b9-497abe3fb078", "address": "fa:16:3e:62:fc:84", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc7922e-33", "ovs_interfaceid": "9bc7922e-33db-4822-a9b9-497abe3fb078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:11:11 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:11 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-481837700',display_name='tempest-AttachVolumeNegativeTest-server-481837700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-481837700',id=5,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCRt23HQ6Lk87P8JMHTotxGoAotUIlM4JOz08FfG/cbe2eknZafwEtDDbG2dcLUw5pHA5nuMO3T0cIx4i2r2H4AHOXbrOZp2o6rHdjN4KUR6ynUZ6xh8kCnDPms+xXmGQ==',key_name='tempest-keypair-1748336898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fad40b5f5e54e7ab9c6f8e78ceb3947',ramdisk_id='',reservation_id='r-j2bd0bsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323727931',owner_user_name='tempest-AttachVolumeNegativeTest-323727931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a7feffde0f74f63a6bd027c1958aacb',uuid=ba0c6dba-0035-4196-a05f-9335436fac86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bc7922e-33db-4822-a9b9-497abe3fb078", "address": "fa:16:3e:62:fc:84", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc7922e-33", "ovs_interfaceid": "9bc7922e-33db-4822-a9b9-497abe3fb078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converting VIF {"id": "9bc7922e-33db-4822-a9b9-497abe3fb078", "address": "fa:16:3e:62:fc:84", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc7922e-33", "ovs_interfaceid": "9bc7922e-33db-4822-a9b9-497abe3fb078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=9bc7922e-33db-4822-a9b9-497abe3fb078,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc7922e-33') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.objects.instance [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'pci_devices' on Instance uuid ba0c6dba-0035-4196-a05f-9335436fac86 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:11:11 user nova-compute[72447]:   <uuid>ba0c6dba-0035-4196-a05f-9335436fac86</uuid>
Jul 31 12:11:11 user nova-compute[72447]:   <name>instance-00000005</name>
Jul 31 12:11:11 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:11:11 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:11:11 user nova-compute[72447]:   <metadata>
Jul 31 12:11:11 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:11:11 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:11:11 user nova-compute[72447]:       <nova:name>tempest-AttachVolumeNegativeTest-server-481837700</nova:name>
Jul 31 12:11:11 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:11:11</nova:creationTime>
Jul 31 12:11:11 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:11:11 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:11:11 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:11:11 user nova-compute[72447]:       <nova:owner>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:user uuid="6a7feffde0f74f63a6bd027c1958aacb">tempest-AttachVolumeNegativeTest-323727931-project-member</nova:user>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:project uuid="7fad40b5f5e54e7ab9c6f8e78ceb3947">tempest-AttachVolumeNegativeTest-323727931</nova:project>
Jul 31 12:11:11 user nova-compute[72447]:       </nova:owner>
Jul 31 12:11:11 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:11:11 user nova-compute[72447]:       <nova:ports>
Jul 31 12:11:11 user nova-compute[72447]:         <nova:port uuid="9bc7922e-33db-4822-a9b9-497abe3fb078">
Jul 31 12:11:11 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 12:11:11 user nova-compute[72447]:         </nova:port>
Jul 31 12:11:11 user nova-compute[72447]:       </nova:ports>
Jul 31 12:11:11 user nova-compute[72447]:     </nova:instance>
Jul 31 12:11:11 user nova-compute[72447]:   </metadata>
Jul 31 12:11:11 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:11:11 user nova-compute[72447]:     <system>
Jul 31 12:11:11 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:11:11 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:11:11 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:11:11 user nova-compute[72447]:       <entry name="serial">ba0c6dba-0035-4196-a05f-9335436fac86</entry>
Jul 31 12:11:11 user nova-compute[72447]:       <entry name="uuid">ba0c6dba-0035-4196-a05f-9335436fac86</entry>
Jul 31 12:11:11 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:11:11 user nova-compute[72447]:     </system>
Jul 31 12:11:11 user nova-compute[72447]:   </sysinfo>
Jul 31 12:11:11 user nova-compute[72447]:   <os>
Jul 31 12:11:11 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:11:11 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:11:11 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:11:11 user nova-compute[72447]:   </os>
Jul 31 12:11:11 user nova-compute[72447]:   <features>
Jul 31 12:11:11 user nova-compute[72447]:     <acpi/>
Jul 31 12:11:11 user nova-compute[72447]:     <apic/>
Jul 31 12:11:11 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:11:11 user nova-compute[72447]:   </features>
Jul 31 12:11:11 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:11:11 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:11:11 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:11:11 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:11:11 user nova-compute[72447]:   </clock>
Jul 31 12:11:11 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:11:11 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:11:11 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:11:11 user nova-compute[72447]:   </cpu>
Jul 31 12:11:11 user nova-compute[72447]:   <devices>
Jul 31 12:11:11 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:11:11 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:11:11 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk"/>
Jul 31 12:11:11 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:11:11 user nova-compute[72447]:     </disk>
Jul 31 12:11:11 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:11:11 user nova-compute[72447]:       <mac address="fa:16:3e:62:fc:84"/>
Jul 31 12:11:11 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:11 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:11:11 user nova-compute[72447]:       <target dev="tap9bc7922e-33"/>
Jul 31 12:11:11 user nova-compute[72447]:     </interface>
Jul 31 12:11:11 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:11:11 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/console.log" append="off"/>
Jul 31 12:11:11 user nova-compute[72447]:     </serial>
Jul 31 12:11:11 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:11:11 user nova-compute[72447]:     <video>
Jul 31 12:11:11 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:11 user nova-compute[72447]:     </video>
Jul 31 12:11:11 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:11:11 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:11:11 user nova-compute[72447]:     </rng>
Jul 31 12:11:11 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:11:11 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:11:11 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:11:11 user nova-compute[72447]:     </memballoon>
Jul 31 12:11:11 user nova-compute[72447]:   </devices>
Jul 31 12:11:11 user nova-compute[72447]: </domain>
Jul 31 12:11:11 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-481837700',display_name='tempest-AttachVolumeNegativeTest-server-481837700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-481837700',id=5,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCRt23HQ6Lk87P8JMHTotxGoAotUIlM4JOz08FfG/cbe2eknZafwEtDDbG2dcLUw5pHA5nuMO3T0cIx4i2r2H4AHOXbrOZp2o6rHdjN4KUR6ynUZ6xh8kCnDPms+xXmGQ==',key_name='tempest-keypair-1748336898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fad40b5f5e54e7ab9c6f8e78ceb3947',ramdisk_id='',reservation_id='r-j2bd0bsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323727931',owner_user_name='tempest-AttachVolumeNegativeTest-323727931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a7feffde0f74f63a6bd027c1958aacb',uuid=ba0c6dba-0035-4196-a05f-9335436fac86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bc7922e-33db-4822-a9b9-497abe3fb078", "address": "fa:16:3e:62:fc:84", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc7922e-33", "ovs_interfaceid": "9bc7922e-33db-4822-a9b9-497abe3fb078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converting VIF {"id": "9bc7922e-33db-4822-a9b9-497abe3fb078", "address": "fa:16:3e:62:fc:84", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc7922e-33", "ovs_interfaceid": "9bc7922e-33db-4822-a9b9-497abe3fb078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=9bc7922e-33db-4822-a9b9-497abe3fb078,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc7922e-33') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG os_vif [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=9bc7922e-33db-4822-a9b9-497abe3fb078,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc7922e-33') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bc7922e-33, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9bc7922e-33, col_values=(('external_ids', {'iface-id': '9bc7922e-33db-4822-a9b9-497abe3fb078', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:fc:84', 'vm-uuid': 'ba0c6dba-0035-4196-a05f-9335436fac86'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:11 user nova-compute[72447]: INFO os_vif [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=9bc7922e-33db-4822-a9b9-497abe3fb078,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc7922e-33')
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:11:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No VIF found with MAC fa:16:3e:62:fc:84, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:11:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-3bb7302a-351d-4af2-87e5-73fec72a74e7 req-65682072-7c96-45a8-881c-68dc911a3e9b service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3bb7302a-351d-4af2-87e5-73fec72a74e7 req-65682072-7c96-45a8-881c-68dc911a3e9b service nova] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3bb7302a-351d-4af2-87e5-73fec72a74e7 req-65682072-7c96-45a8-881c-68dc911a3e9b service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3bb7302a-351d-4af2-87e5-73fec72a74e7 req-65682072-7c96-45a8-881c-68dc911a3e9b service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-3bb7302a-351d-4af2-87e5-73fec72a74e7 req-65682072-7c96-45a8-881c-68dc911a3e9b service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] No waiting events found dispatching network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:12 user nova-compute[72447]: WARNING nova.compute.manager [req-3bb7302a-351d-4af2-87e5-73fec72a74e7 req-65682072-7c96-45a8-881c-68dc911a3e9b service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received unexpected event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e for instance with vm_state building and task_state spawning.
Jul 31 12:11:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.network.neutron [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updated VIF entry in instance network info cache for port c9c41aee-bb54-4d97-8f69-9dd65e2c97b7. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.network.neutron [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updating instance_info_cache with network_info: [{"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b275f51b-e5c8-424a-95b7-67ac6ba706dd req-fc55d2de-5c40-49ed-bdfa-6a885538305c service nova] Releasing lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805473.4634573, 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:13 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] VM Resumed (Lifecycle Event)
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:13 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Instance spawned successfully.
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:13 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805473.4861405, 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:13 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] VM Started (Lifecycle Event)
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:13 user nova-compute[72447]: INFO nova.compute.manager [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Took 13.93 seconds to spawn the instance on the hypervisor.
Jul 31 12:11:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:13 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:13 user nova-compute[72447]: INFO nova.compute.manager [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Took 14.79 seconds to build instance.
Jul 31 12:11:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0329740a-594b-4fab-a938-1cc3eac2bc42 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.949s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-dffc9894-d6ff-4351-9f56-331a620a1f52 req-05fc0d8a-0bf8-445e-a528-060fe806b88c service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-dffc9894-d6ff-4351-9f56-331a620a1f52 req-05fc0d8a-0bf8-445e-a528-060fe806b88c service nova] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-dffc9894-d6ff-4351-9f56-331a620a1f52 req-05fc0d8a-0bf8-445e-a528-060fe806b88c service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-dffc9894-d6ff-4351-9f56-331a620a1f52 req-05fc0d8a-0bf8-445e-a528-060fe806b88c service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-dffc9894-d6ff-4351-9f56-331a620a1f52 req-05fc0d8a-0bf8-445e-a528-060fe806b88c service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] No waiting events found dispatching network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:14 user nova-compute[72447]: WARNING nova.compute.manager [req-dffc9894-d6ff-4351-9f56-331a620a1f52 req-05fc0d8a-0bf8-445e-a528-060fe806b88c service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received unexpected event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e for instance with vm_state active and task_state None.
Jul 31 12:11:15 user nova-compute[72447]: DEBUG nova.network.neutron [req-37b7b34e-0efe-44ef-8df3-86a7d6663d12 req-f87d3bb5-7892-4606-88a5-7fe31f0da808 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Updated VIF entry in instance network info cache for port 9bc7922e-33db-4822-a9b9-497abe3fb078. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG nova.network.neutron [req-37b7b34e-0efe-44ef-8df3-86a7d6663d12 req-f87d3bb5-7892-4606-88a5-7fe31f0da808 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Updating instance_info_cache with network_info: [{"id": "9bc7922e-33db-4822-a9b9-497abe3fb078", "address": "fa:16:3e:62:fc:84", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc7922e-33", "ovs_interfaceid": "9bc7922e-33db-4822-a9b9-497abe3fb078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37b7b34e-0efe-44ef-8df3-86a7d6663d12 req-f87d3bb5-7892-4606-88a5-7fe31f0da808 service nova] Releasing lock "refresh_cache-ba0c6dba-0035-4196-a05f-9335436fac86" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG nova.compute.manager [req-a62852a0-4779-483d-96df-b45e354f93c3 req-a2c9726b-cc35-4633-8c4e-df0298705a05 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Received event network-vif-plugged-9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a62852a0-4779-483d-96df-b45e354f93c3 req-a2c9726b-cc35-4633-8c4e-df0298705a05 service nova] Acquiring lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a62852a0-4779-483d-96df-b45e354f93c3 req-a2c9726b-cc35-4633-8c4e-df0298705a05 service nova] Lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a62852a0-4779-483d-96df-b45e354f93c3 req-a2c9726b-cc35-4633-8c4e-df0298705a05 service nova] Lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:15 user nova-compute[72447]: DEBUG nova.compute.manager [req-a62852a0-4779-483d-96df-b45e354f93c3 req-a2c9726b-cc35-4633-8c4e-df0298705a05 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] No waiting events found dispatching network-vif-plugged-9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:15 user nova-compute[72447]: WARNING nova.compute.manager [req-a62852a0-4779-483d-96df-b45e354f93c3 req-a2c9726b-cc35-4633-8c4e-df0298705a05 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Received unexpected event network-vif-plugged-9bc7922e-33db-4822-a9b9-497abe3fb078 for instance with vm_state building and task_state spawning.
Jul 31 12:11:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-78c3ec44-e37a-43bc-bdb3-4627b739f6e5 req-39a55619-ce3f-437c-9f50-d4e2dfc780ab service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Received event network-vif-plugged-9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-78c3ec44-e37a-43bc-bdb3-4627b739f6e5 req-39a55619-ce3f-437c-9f50-d4e2dfc780ab service nova] Acquiring lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-78c3ec44-e37a-43bc-bdb3-4627b739f6e5 req-39a55619-ce3f-437c-9f50-d4e2dfc780ab service nova] Lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-78c3ec44-e37a-43bc-bdb3-4627b739f6e5 req-39a55619-ce3f-437c-9f50-d4e2dfc780ab service nova] Lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-78c3ec44-e37a-43bc-bdb3-4627b739f6e5 req-39a55619-ce3f-437c-9f50-d4e2dfc780ab service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] No waiting events found dispatching network-vif-plugged-9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:17 user nova-compute[72447]: WARNING nova.compute.manager [req-78c3ec44-e37a-43bc-bdb3-4627b739f6e5 req-39a55619-ce3f-437c-9f50-d4e2dfc780ab service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Received unexpected event network-vif-plugged-9bc7922e-33db-4822-a9b9-497abe3fb078 for instance with vm_state building and task_state spawning.
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [req-cae7e048-8ead-499f-b2d2-b05336d01124 req-346d8841-717f-4e5a-977a-ff4e290f0bb1 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cae7e048-8ead-499f-b2d2-b05336d01124 req-346d8841-717f-4e5a-977a-ff4e290f0bb1 service nova] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cae7e048-8ead-499f-b2d2-b05336d01124 req-346d8841-717f-4e5a-977a-ff4e290f0bb1 service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cae7e048-8ead-499f-b2d2-b05336d01124 req-346d8841-717f-4e5a-977a-ff4e290f0bb1 service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [req-cae7e048-8ead-499f-b2d2-b05336d01124 req-346d8841-717f-4e5a-977a-ff4e290f0bb1 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] No waiting events found dispatching network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:18 user nova-compute[72447]: WARNING nova.compute.manager [req-cae7e048-8ead-499f-b2d2-b05336d01124 req-346d8841-717f-4e5a-977a-ff4e290f0bb1 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received unexpected event network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 for instance with vm_state building and task_state spawning.
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805478.2148654, 6c701045-e520-421f-94d2-b54edd0d5c54 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] VM Resumed (Lifecycle Event)
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Instance spawned successfully.
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Instance spawned successfully.
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805478.2209277, 6c701045-e520-421f-94d2-b54edd0d5c54 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] VM Started (Lifecycle Event)
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.compute.manager [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Took 17.83 seconds to spawn the instance on the hypervisor.
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805478.234219, ba0c6dba-0035-4196-a05f-9335436fac86 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] VM Resumed (Lifecycle Event)
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.compute.manager [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Took 16.07 seconds to spawn the instance on the hypervisor.
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805478.2344525, ba0c6dba-0035-4196-a05f-9335436fac86 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] VM Started (Lifecycle Event)
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.compute.manager [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Took 19.22 seconds to build instance.
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:18 user nova-compute[72447]: INFO nova.compute.manager [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Took 17.14 seconds to build instance.
Jul 31 12:11:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-edf96ff1-7904-48a6-ae3d-61f274eca5d2 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "6c701045-e520-421f-94d2-b54edd0d5c54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.465s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-243655ed-58c3-4d9f-81cf-822ca17702e7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "ba0c6dba-0035-4196-a05f-9335436fac86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.332s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:20 user nova-compute[72447]: DEBUG nova.compute.manager [req-88ee4caa-42c2-49b4-b773-ec9a9f80f9b7 req-303688d6-cb8b-4da6-9bd6-ceaa4d9cf6b9 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-88ee4caa-42c2-49b4-b773-ec9a9f80f9b7 req-303688d6-cb8b-4da6-9bd6-ceaa4d9cf6b9 service nova] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-88ee4caa-42c2-49b4-b773-ec9a9f80f9b7 req-303688d6-cb8b-4da6-9bd6-ceaa4d9cf6b9 service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-88ee4caa-42c2-49b4-b773-ec9a9f80f9b7 req-303688d6-cb8b-4da6-9bd6-ceaa4d9cf6b9 service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:20 user nova-compute[72447]: DEBUG nova.compute.manager [req-88ee4caa-42c2-49b4-b773-ec9a9f80f9b7 req-303688d6-cb8b-4da6-9bd6-ceaa4d9cf6b9 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] No waiting events found dispatching network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:20 user nova-compute[72447]: WARNING nova.compute.manager [req-88ee4caa-42c2-49b4-b773-ec9a9f80f9b7 req-303688d6-cb8b-4da6-9bd6-ceaa4d9cf6b9 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received unexpected event network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 for instance with vm_state active and task_state None.
Jul 31 12:11:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:11:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:26 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:11:26 user nova-compute[72447]: INFO nova.compute.claims [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Claim successful on node user
Jul 31 12:11:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG nova.network.neutron [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:11:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 31 12:11:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG nova.policy [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8be3e4842784437c91dedee143c34a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334e410fe41c47169d8587fda6d752a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:11:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Creating image(s)
Jul 31 12:11:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "/opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "/opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "c796b29ef0ffe5d92001adcab930a84d6f474818" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "c796b29ef0ffe5d92001adcab930a84d6f474818" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818.part --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818.part --force-share --output=json" returned: 0 in 0.176s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:28 user nova-compute[72447]: DEBUG nova.virt.images [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] ab24c7c8-5d34-4187-bc9e-07898abeb3f8 was qcow2, converting to raw {{(pid=72447) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 12:11:28 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:11:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818.part /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818.converted {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818.part /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818.converted" returned: 0 in 0.176s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818.converted --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "c796b29ef0ffe5d92001adcab930a84d6f474818" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.184s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818 --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818 --force-share --output=json" returned: 0 in 0.298s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "c796b29ef0ffe5d92001adcab930a84d6f474818" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "c796b29ef0ffe5d92001adcab930a84d6f474818" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818 --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818 --force-share --output=json" returned: 0 in 0.173s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818,backing_fmt=raw /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818,backing_fmt=raw /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk 1073741824" returned: 0 in 0.072s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "c796b29ef0ffe5d92001adcab930a84d6f474818" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818 --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG nova.network.neutron [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Successfully created port: c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818 --force-share --output=json" returned: 0 in 0.217s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Cannot resize image /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG nova.objects.instance [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lazy-loading 'migration_context' on Instance uuid fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Ensure instance console log exists: /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:11:29 user nova-compute[72447]: INFO nova.compute.claims [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Claim successful on node user
Jul 31 12:11:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:11:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:30 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:11:30 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:11:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.883s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:11:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.553s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:30 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:11:30 user nova-compute[72447]: INFO nova.compute.claims [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Claim successful on node user
Jul 31 12:11:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:11:30 user nova-compute[72447]: DEBUG nova.network.neutron [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:11:30 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:11:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:11:30 user nova-compute[72447]: DEBUG nova.network.neutron [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Successfully updated port: c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:11:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "refresh_cache-fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquired lock "refresh_cache-fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.policy [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd71c3e48f72842709366c6ad635fca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f78f7104db98fe0e537d3f22208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-bf867d1c-42ea-4b96-8f60-4d9a6af31f3d req-d6badd89-570a-4956-83d8-55ac56911c80 service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Received event network-changed-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-bf867d1c-42ea-4b96-8f60-4d9a6af31f3d req-d6badd89-570a-4956-83d8-55ac56911c80 service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Refreshing instance network info cache due to event network-changed-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bf867d1c-42ea-4b96-8f60-4d9a6af31f3d req-d6badd89-570a-4956-83d8-55ac56911c80 service nova] Acquiring lock "refresh_cache-fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:11:31 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Creating image(s)
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.160s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.150s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk 1073741824" returned: 0 in 0.049s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.836s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Updating instance_info_cache with network_info: [{"id": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "address": "fa:16:3e:d7:54:1c", "network": {"id": "891f8f1e-f53f-46a2-82a6-daa0b2a69504", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-521582482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e410fe41c47169d8587fda6d752a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69205df-b8", "ovs_interfaceid": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Releasing lock "refresh_cache-fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Instance network_info: |[{"id": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "address": "fa:16:3e:d7:54:1c", "network": {"id": "891f8f1e-f53f-46a2-82a6-daa0b2a69504", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-521582482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e410fe41c47169d8587fda6d752a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69205df-b8", "ovs_interfaceid": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.196s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bf867d1c-42ea-4b96-8f60-4d9a6af31f3d req-d6badd89-570a-4956-83d8-55ac56911c80 service nova] Acquired lock "refresh_cache-fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-bf867d1c-42ea-4b96-8f60-4d9a6af31f3d req-d6badd89-570a-4956-83d8-55ac56911c80 service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Refreshing network info cache for port c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Start _get_guest_xml network_info=[{"id": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "address": "fa:16:3e:d7:54:1c", "network": {"id": "891f8f1e-f53f-46a2-82a6-daa0b2a69504", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-521582482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e410fe41c47169d8587fda6d752a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69205df-b8", "ovs_interfaceid": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:11:16Z,direct_url=<?>,disk_format='qcow2',id=ab24c7c8-5d34-4187-bc9e-07898abeb3f8,min_disk=0,min_ram=0,name='',owner='c9d0e570ce7648c59baef4ce9b8e3f70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:11:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'boot_index': 0, 'image_id': 'ab24c7c8-5d34-4187-bc9e-07898abeb3f8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:11:31 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:31 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:31 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:11:16Z,direct_url=<?>,disk_format='qcow2',id=ab24c7c8-5d34-4187-bc9e-07898abeb3f8,min_disk=0,min_ram=0,name='',owner='c9d0e570ce7648c59baef4ce9b8e3f70',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:11:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-619398897',display_name='tempest-AttachSCSIVolumeTestJSON-server-619398897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-619398897',id=6,image_ref='ab24c7c8-5d34-4187-bc9e-07898abeb3f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpZHa3zOPjXnIXSYwTWFNVB+fmhTSwWPFtgeIqHgj7lXEpJo4KIy6jvjaoTQwM3vHvZk9vTiac8VgyGN2wzP14xt3uz3TUzOnETwdJK+4ZhXI/JyG4MGgVnPjIASQ86ZA==',key_name='tempest-keypair-1549770097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='334e410fe41c47169d8587fda6d752a2',ramdisk_id='',reservation_id='r-mj2xmazt',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ab24c7c8-5d34-4187-bc9e-07898abeb3f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1215701056',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1215701056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8be3e4842784437c91dedee143c34a96',uuid=fd2cf3ad-9409-44ea-9718-7fc6033bd0d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "address": "fa:16:3e:d7:54:1c", "network": {"id": "891f8f1e-f53f-46a2-82a6-daa0b2a69504", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-521582482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e410fe41c47169d8587fda6d752a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69205df-b8", "ovs_interfaceid": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Converting VIF {"id": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "address": "fa:16:3e:d7:54:1c", "network": {"id": "891f8f1e-f53f-46a2-82a6-daa0b2a69504", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-521582482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e410fe41c47169d8587fda6d752a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69205df-b8", "ovs_interfaceid": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=c69205df-b8b2-4c1d-a7d5-aa4fff4b2476,network=Network(891f8f1e-f53f-46a2-82a6-daa0b2a69504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69205df-b8') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.objects.instance [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lazy-loading 'pci_devices' on Instance uuid fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:11:31 user nova-compute[72447]:   <uuid>fd2cf3ad-9409-44ea-9718-7fc6033bd0d8</uuid>
Jul 31 12:11:31 user nova-compute[72447]:   <name>instance-00000006</name>
Jul 31 12:11:31 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:11:31 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:11:31 user nova-compute[72447]:   <metadata>
Jul 31 12:11:31 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:11:31 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:11:31 user nova-compute[72447]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-619398897</nova:name>
Jul 31 12:11:31 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:11:31</nova:creationTime>
Jul 31 12:11:31 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:11:31 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:11:31 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:11:31 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:11:31 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:11:31 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:11:31 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:11:31 user nova-compute[72447]:       <nova:owner>
Jul 31 12:11:31 user nova-compute[72447]:         <nova:user uuid="8be3e4842784437c91dedee143c34a96">tempest-AttachSCSIVolumeTestJSON-1215701056-project-member</nova:user>
Jul 31 12:11:31 user nova-compute[72447]:         <nova:project uuid="334e410fe41c47169d8587fda6d752a2">tempest-AttachSCSIVolumeTestJSON-1215701056</nova:project>
Jul 31 12:11:31 user nova-compute[72447]:       </nova:owner>
Jul 31 12:11:31 user nova-compute[72447]:       <nova:root type="image" uuid="ab24c7c8-5d34-4187-bc9e-07898abeb3f8"/>
Jul 31 12:11:31 user nova-compute[72447]:       <nova:ports>
Jul 31 12:11:31 user nova-compute[72447]:         <nova:port uuid="c69205df-b8b2-4c1d-a7d5-aa4fff4b2476">
Jul 31 12:11:31 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 12:11:31 user nova-compute[72447]:         </nova:port>
Jul 31 12:11:31 user nova-compute[72447]:       </nova:ports>
Jul 31 12:11:31 user nova-compute[72447]:     </nova:instance>
Jul 31 12:11:31 user nova-compute[72447]:   </metadata>
Jul 31 12:11:31 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:11:31 user nova-compute[72447]:     <system>
Jul 31 12:11:31 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:11:31 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:11:31 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:11:31 user nova-compute[72447]:       <entry name="serial">fd2cf3ad-9409-44ea-9718-7fc6033bd0d8</entry>
Jul 31 12:11:31 user nova-compute[72447]:       <entry name="uuid">fd2cf3ad-9409-44ea-9718-7fc6033bd0d8</entry>
Jul 31 12:11:31 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:11:31 user nova-compute[72447]:     </system>
Jul 31 12:11:31 user nova-compute[72447]:   </sysinfo>
Jul 31 12:11:31 user nova-compute[72447]:   <os>
Jul 31 12:11:31 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:11:31 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:11:31 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:11:31 user nova-compute[72447]:   </os>
Jul 31 12:11:31 user nova-compute[72447]:   <features>
Jul 31 12:11:31 user nova-compute[72447]:     <acpi/>
Jul 31 12:11:31 user nova-compute[72447]:     <apic/>
Jul 31 12:11:31 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:11:31 user nova-compute[72447]:   </features>
Jul 31 12:11:31 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:11:31 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:11:31 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:11:31 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:11:31 user nova-compute[72447]:   </clock>
Jul 31 12:11:31 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:11:31 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:11:31 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:11:31 user nova-compute[72447]:   </cpu>
Jul 31 12:11:31 user nova-compute[72447]:   <devices>
Jul 31 12:11:31 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:11:31 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:11:31 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk"/>
Jul 31 12:11:31 user nova-compute[72447]:       <target dev="sda" bus="scsi"/>
Jul 31 12:11:31 user nova-compute[72447]:       <address type="drive" controller="0" unit="0"/>
Jul 31 12:11:31 user nova-compute[72447]:     </disk>
Jul 31 12:11:31 user nova-compute[72447]:     <disk type="file" device="cdrom">
Jul 31 12:11:31 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 12:11:31 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk.config"/>
Jul 31 12:11:31 user nova-compute[72447]:       <target dev="sdb" bus="scsi"/>
Jul 31 12:11:31 user nova-compute[72447]:       <address type="drive" controller="0" unit="1"/>
Jul 31 12:11:31 user nova-compute[72447]:     </disk>
Jul 31 12:11:31 user nova-compute[72447]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 31 12:11:31 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:11:31 user nova-compute[72447]:       <mac address="fa:16:3e:d7:54:1c"/>
Jul 31 12:11:31 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:31 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:11:31 user nova-compute[72447]:       <target dev="tapc69205df-b8"/>
Jul 31 12:11:31 user nova-compute[72447]:     </interface>
Jul 31 12:11:31 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:11:31 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/console.log" append="off"/>
Jul 31 12:11:31 user nova-compute[72447]:     </serial>
Jul 31 12:11:31 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:11:31 user nova-compute[72447]:     <video>
Jul 31 12:11:31 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:31 user nova-compute[72447]:     </video>
Jul 31 12:11:31 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:11:31 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:11:31 user nova-compute[72447]:     </rng>
Jul 31 12:11:31 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:11:31 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:11:31 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:11:31 user nova-compute[72447]:     </memballoon>
Jul 31 12:11:31 user nova-compute[72447]:   </devices>
Jul 31 12:11:31 user nova-compute[72447]: </domain>
Jul 31 12:11:31 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-619398897',display_name='tempest-AttachSCSIVolumeTestJSON-server-619398897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-619398897',id=6,image_ref='ab24c7c8-5d34-4187-bc9e-07898abeb3f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpZHa3zOPjXnIXSYwTWFNVB+fmhTSwWPFtgeIqHgj7lXEpJo4KIy6jvjaoTQwM3vHvZk9vTiac8VgyGN2wzP14xt3uz3TUzOnETwdJK+4ZhXI/JyG4MGgVnPjIASQ86ZA==',key_name='tempest-keypair-1549770097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='334e410fe41c47169d8587fda6d752a2',ramdisk_id='',reservation_id='r-mj2xmazt',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ab24c7c8-5d34-4187-bc9e-07898abeb3f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1215701056',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1215701056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8be3e4842784437c91dedee143c34a96',uuid=fd2cf3ad-9409-44ea-9718-7fc6033bd0d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "address": "fa:16:3e:d7:54:1c", "network": {"id": "891f8f1e-f53f-46a2-82a6-daa0b2a69504", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-521582482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e410fe41c47169d8587fda6d752a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69205df-b8", "ovs_interfaceid": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Converting VIF {"id": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "address": "fa:16:3e:d7:54:1c", "network": {"id": "891f8f1e-f53f-46a2-82a6-daa0b2a69504", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-521582482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e410fe41c47169d8587fda6d752a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69205df-b8", "ovs_interfaceid": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=c69205df-b8b2-4c1d-a7d5-aa4fff4b2476,network=Network(891f8f1e-f53f-46a2-82a6-daa0b2a69504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69205df-b8') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG os_vif [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=c69205df-b8b2-4c1d-a7d5-aa4fff4b2476,network=Network(891f8f1e-f53f-46a2-82a6-daa0b2a69504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69205df-b8') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc69205df-b8, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc69205df-b8, col_values=(('external_ids', {'iface-id': 'c69205df-b8b2-4c1d-a7d5-aa4fff4b2476', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:54:1c', 'vm-uuid': 'fd2cf3ad-9409-44ea-9718-7fc6033bd0d8'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Cannot resize image /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.objects.instance [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lazy-loading 'migration_context' on Instance uuid b8929e20-a1f2-4a9c-a0c8-e0241113f0af {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:31 user nova-compute[72447]: INFO os_vif [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=c69205df-b8b2-4c1d-a7d5-aa4fff4b2476,network=Network(891f8f1e-f53f-46a2-82a6-daa0b2a69504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69205df-b8')
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Ensure instance console log exists: /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] No BDM found with device name sda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:11:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] No VIF found with MAC fa:16:3e:d7:54:1c, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:11:31 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Using config drive
Jul 31 12:11:32 user nova-compute[72447]: DEBUG nova.compute.manager [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:11:32 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Creating image(s)
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "/opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "/opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "/opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG nova.policy [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b741b81c8ee4de19841fa3ae911bc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639d35cc656e4dae8c062e531e6d2dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG nova.network.neutron [req-bf867d1c-42ea-4b96-8f60-4d9a6af31f3d req-d6badd89-570a-4956-83d8-55ac56911c80 service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Updated VIF entry in instance network info cache for port c69205df-b8b2-4c1d-a7d5-aa4fff4b2476. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG nova.network.neutron [req-bf867d1c-42ea-4b96-8f60-4d9a6af31f3d req-d6badd89-570a-4956-83d8-55ac56911c80 service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Updating instance_info_cache with network_info: [{"id": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "address": "fa:16:3e:d7:54:1c", "network": {"id": "891f8f1e-f53f-46a2-82a6-daa0b2a69504", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-521582482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e410fe41c47169d8587fda6d752a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69205df-b8", "ovs_interfaceid": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk 1073741824" returned: 0 in 0.062s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bf867d1c-42ea-4b96-8f60-4d9a6af31f3d req-d6badd89-570a-4956-83d8-55ac56911c80 service nova] Releasing lock "refresh_cache-fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG nova.network.neutron [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Successfully created port: 4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:11:32 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Creating config drive at /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk.config
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp527aj0xk {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Cannot resize image /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG nova.objects.instance [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lazy-loading 'migration_context' on Instance uuid 700d80d6-9248-4d6f-9010-c3904d8fec2c {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp527aj0xk" returned: 0 in 0.053s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Ensure instance console log exists: /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:33 user nova-compute[72447]: DEBUG nova.network.neutron [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Successfully created port: 29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:11:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG nova.network.neutron [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Successfully updated port: 4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquired lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG nova.network.neutron [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-a8d7668e-8fc4-4cf8-ac0b-3ea8c43f4101 req-e87d747b-5492-4157-a1f8-d6d8cd25fbc8 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-changed-4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-a8d7668e-8fc4-4cf8-ac0b-3ea8c43f4101 req-e87d747b-5492-4157-a1f8-d6d8cd25fbc8 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Refreshing instance network info cache due to event network-changed-4607d653-6d85-46b9-b00e-39748d9afb78. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a8d7668e-8fc4-4cf8-ac0b-3ea8c43f4101 req-e87d747b-5492-4157-a1f8-d6d8cd25fbc8 service nova] Acquiring lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG nova.network.neutron [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-cba28690-2b9d-45b9-acad-1df5d14ad117 req-cebe36db-5351-4bc0-be6d-cfb52e3357dc service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Received event network-vif-plugged-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cba28690-2b9d-45b9-acad-1df5d14ad117 req-cebe36db-5351-4bc0-be6d-cfb52e3357dc service nova] Acquiring lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cba28690-2b9d-45b9-acad-1df5d14ad117 req-cebe36db-5351-4bc0-be6d-cfb52e3357dc service nova] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cba28690-2b9d-45b9-acad-1df5d14ad117 req-cebe36db-5351-4bc0-be6d-cfb52e3357dc service nova] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-cba28690-2b9d-45b9-acad-1df5d14ad117 req-cebe36db-5351-4bc0-be6d-cfb52e3357dc service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] No waiting events found dispatching network-vif-plugged-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:34 user nova-compute[72447]: WARNING nova.compute.manager [req-cba28690-2b9d-45b9-acad-1df5d14ad117 req-cebe36db-5351-4bc0-be6d-cfb52e3357dc service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Received unexpected event network-vif-plugged-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 for instance with vm_state building and task_state spawning.
Jul 31 12:11:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.network.neutron [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Updating instance_info_cache with network_info: [{"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Releasing lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Instance network_info: |[{"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a8d7668e-8fc4-4cf8-ac0b-3ea8c43f4101 req-e87d747b-5492-4157-a1f8-d6d8cd25fbc8 service nova] Acquired lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.network.neutron [req-a8d7668e-8fc4-4cf8-ac0b-3ea8c43f4101 req-e87d747b-5492-4157-a1f8-d6d8cd25fbc8 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Refreshing network info cache for port 4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Start _get_guest_xml network_info=[{"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:11:35 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:35 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.network.neutron [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Successfully updated port: 29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1947605890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1947605890',id=7,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn5YeitERNgZiavoklE86RU3W69tKvanqOuX1Z4JM4bRcMNOeZRTBb//da8RjvsuxuqMZXyuEd1IjLCPuMWJJvrbNo/sdXOTs0iSDWka1Ds3bPHY+Kbf22pgZ3qNjgNdg==',key_name='tempest-keypair-117256101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9a05f78f7104db98fe0e537d3f22208',ramdisk_id='',reservation_id='r-7n456tj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1246153700',owner_user_name='tempest-TaggedAttachmentsTest-1246153700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d71c3e48f72842709366c6ad635fca49',uuid=b8929e20-a1f2-4a9c-a0c8-e0241113f0af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converting VIF {"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:a9:05,bridge_name='br-int',has_traffic_filtering=True,id=4607d653-6d85-46b9-b00e-39748d9afb78,network=Network(e5e1be84-34e1-4fd8-88de-981e3c2898db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4607d653-6d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.objects.instance [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lazy-loading 'pci_devices' on Instance uuid b8929e20-a1f2-4a9c-a0c8-e0241113f0af {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "refresh_cache-700d80d6-9248-4d6f-9010-c3904d8fec2c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquired lock "refresh_cache-700d80d6-9248-4d6f-9010-c3904d8fec2c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.network.neutron [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:11:35 user nova-compute[72447]:   <uuid>b8929e20-a1f2-4a9c-a0c8-e0241113f0af</uuid>
Jul 31 12:11:35 user nova-compute[72447]:   <name>instance-00000007</name>
Jul 31 12:11:35 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:11:35 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:11:35 user nova-compute[72447]:   <metadata>
Jul 31 12:11:35 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:11:35 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:11:35 user nova-compute[72447]:       <nova:name>tempest-device-tagging-server-1947605890</nova:name>
Jul 31 12:11:35 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:11:35</nova:creationTime>
Jul 31 12:11:35 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:11:35 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:11:35 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:11:35 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:11:35 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:11:35 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:11:35 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:11:35 user nova-compute[72447]:       <nova:owner>
Jul 31 12:11:35 user nova-compute[72447]:         <nova:user uuid="d71c3e48f72842709366c6ad635fca49">tempest-TaggedAttachmentsTest-1246153700-project-member</nova:user>
Jul 31 12:11:35 user nova-compute[72447]:         <nova:project uuid="f9a05f78f7104db98fe0e537d3f22208">tempest-TaggedAttachmentsTest-1246153700</nova:project>
Jul 31 12:11:35 user nova-compute[72447]:       </nova:owner>
Jul 31 12:11:35 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:11:35 user nova-compute[72447]:       <nova:ports>
Jul 31 12:11:35 user nova-compute[72447]:         <nova:port uuid="4607d653-6d85-46b9-b00e-39748d9afb78">
Jul 31 12:11:35 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:11:35 user nova-compute[72447]:         </nova:port>
Jul 31 12:11:35 user nova-compute[72447]:       </nova:ports>
Jul 31 12:11:35 user nova-compute[72447]:     </nova:instance>
Jul 31 12:11:35 user nova-compute[72447]:   </metadata>
Jul 31 12:11:35 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:11:35 user nova-compute[72447]:     <system>
Jul 31 12:11:35 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:11:35 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:11:35 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:11:35 user nova-compute[72447]:       <entry name="serial">b8929e20-a1f2-4a9c-a0c8-e0241113f0af</entry>
Jul 31 12:11:35 user nova-compute[72447]:       <entry name="uuid">b8929e20-a1f2-4a9c-a0c8-e0241113f0af</entry>
Jul 31 12:11:35 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:11:35 user nova-compute[72447]:     </system>
Jul 31 12:11:35 user nova-compute[72447]:   </sysinfo>
Jul 31 12:11:35 user nova-compute[72447]:   <os>
Jul 31 12:11:35 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:11:35 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:11:35 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:11:35 user nova-compute[72447]:   </os>
Jul 31 12:11:35 user nova-compute[72447]:   <features>
Jul 31 12:11:35 user nova-compute[72447]:     <acpi/>
Jul 31 12:11:35 user nova-compute[72447]:     <apic/>
Jul 31 12:11:35 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:11:35 user nova-compute[72447]:   </features>
Jul 31 12:11:35 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:11:35 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:11:35 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:11:35 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:11:35 user nova-compute[72447]:   </clock>
Jul 31 12:11:35 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:11:35 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:11:35 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:11:35 user nova-compute[72447]:   </cpu>
Jul 31 12:11:35 user nova-compute[72447]:   <devices>
Jul 31 12:11:35 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:11:35 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:11:35 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk"/>
Jul 31 12:11:35 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:11:35 user nova-compute[72447]:     </disk>
Jul 31 12:11:35 user nova-compute[72447]:     <disk type="file" device="cdrom">
Jul 31 12:11:35 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 12:11:35 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk.config"/>
Jul 31 12:11:35 user nova-compute[72447]:       <target dev="hda" bus="ide"/>
Jul 31 12:11:35 user nova-compute[72447]:     </disk>
Jul 31 12:11:35 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:11:35 user nova-compute[72447]:       <mac address="fa:16:3e:46:a9:05"/>
Jul 31 12:11:35 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:35 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:11:35 user nova-compute[72447]:       <target dev="tap4607d653-6d"/>
Jul 31 12:11:35 user nova-compute[72447]:     </interface>
Jul 31 12:11:35 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:11:35 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/console.log" append="off"/>
Jul 31 12:11:35 user nova-compute[72447]:     </serial>
Jul 31 12:11:35 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:11:35 user nova-compute[72447]:     <video>
Jul 31 12:11:35 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:35 user nova-compute[72447]:     </video>
Jul 31 12:11:35 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:11:35 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:11:35 user nova-compute[72447]:     </rng>
Jul 31 12:11:35 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:11:35 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:11:35 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:11:35 user nova-compute[72447]:     </memballoon>
Jul 31 12:11:35 user nova-compute[72447]:   </devices>
Jul 31 12:11:35 user nova-compute[72447]: </domain>
Jul 31 12:11:35 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1947605890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1947605890',id=7,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn5YeitERNgZiavoklE86RU3W69tKvanqOuX1Z4JM4bRcMNOeZRTBb//da8RjvsuxuqMZXyuEd1IjLCPuMWJJvrbNo/sdXOTs0iSDWka1Ds3bPHY+Kbf22pgZ3qNjgNdg==',key_name='tempest-keypair-117256101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9a05f78f7104db98fe0e537d3f22208',ramdisk_id='',reservation_id='r-7n456tj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1246153700',owner_user_name='tempest-TaggedAttachmentsTest-1246153700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d71c3e48f72842709366c6ad635fca49',uuid=b8929e20-a1f2-4a9c-a0c8-e0241113f0af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converting VIF {"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:a9:05,bridge_name='br-int',has_traffic_filtering=True,id=4607d653-6d85-46b9-b00e-39748d9afb78,network=Network(e5e1be84-34e1-4fd8-88de-981e3c2898db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4607d653-6d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG os_vif [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a9:05,bridge_name='br-int',has_traffic_filtering=True,id=4607d653-6d85-46b9-b00e-39748d9afb78,network=Network(e5e1be84-34e1-4fd8-88de-981e3c2898db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4607d653-6d') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4607d653-6d, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4607d653-6d, col_values=(('external_ids', {'iface-id': '4607d653-6d85-46b9-b00e-39748d9afb78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:a9:05', 'vm-uuid': 'b8929e20-a1f2-4a9c-a0c8-e0241113f0af'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:11:35 user nova-compute[72447]: INFO os_vif [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a9:05,bridge_name='br-int',has_traffic_filtering=True,id=4607d653-6d85-46b9-b00e-39748d9afb78,network=Network(e5e1be84-34e1-4fd8-88de-981e3c2898db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4607d653-6d')
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.network.neutron [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] No BDM found with device name hda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] No VIF found with MAC fa:16:3e:46:a9:05, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:11:36 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Using config drive
Jul 31 12:11:36 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Creating config drive at /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk.config
Jul 31 12:11:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjhxqg4f1 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjhxqg4f1" returned: 0 in 0.060s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-4cde5cd3-0fb7-4850-9760-9113d4b4230b req-d369988b-727c-4fb3-9ae2-1af17d72d816 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Received event network-changed-29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-4cde5cd3-0fb7-4850-9760-9113d4b4230b req-d369988b-727c-4fb3-9ae2-1af17d72d816 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Refreshing instance network info cache due to event network-changed-29928bd0-ae23-4a93-ba76-d4df44512908. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4cde5cd3-0fb7-4850-9760-9113d4b4230b req-d369988b-727c-4fb3-9ae2-1af17d72d816 service nova] Acquiring lock "refresh_cache-700d80d6-9248-4d6f-9010-c3904d8fec2c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.network.neutron [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Updating instance_info_cache with network_info: [{"id": "29928bd0-ae23-4a93-ba76-d4df44512908", "address": "fa:16:3e:35:f3:1f", "network": {"id": "9e4d5fcf-1179-404a-97a7-bf749934d047", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1726752963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639d35cc656e4dae8c062e531e6d2dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29928bd0-ae", "ovs_interfaceid": "29928bd0-ae23-4a93-ba76-d4df44512908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Releasing lock "refresh_cache-700d80d6-9248-4d6f-9010-c3904d8fec2c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.compute.manager [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Instance network_info: |[{"id": "29928bd0-ae23-4a93-ba76-d4df44512908", "address": "fa:16:3e:35:f3:1f", "network": {"id": "9e4d5fcf-1179-404a-97a7-bf749934d047", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1726752963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639d35cc656e4dae8c062e531e6d2dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29928bd0-ae", "ovs_interfaceid": "29928bd0-ae23-4a93-ba76-d4df44512908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4cde5cd3-0fb7-4850-9760-9113d4b4230b req-d369988b-727c-4fb3-9ae2-1af17d72d816 service nova] Acquired lock "refresh_cache-700d80d6-9248-4d6f-9010-c3904d8fec2c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.network.neutron [req-4cde5cd3-0fb7-4850-9760-9113d4b4230b req-d369988b-727c-4fb3-9ae2-1af17d72d816 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Refreshing network info cache for port 29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Start _get_guest_xml network_info=[{"id": "29928bd0-ae23-4a93-ba76-d4df44512908", "address": "fa:16:3e:35:f3:1f", "network": {"id": "9e4d5fcf-1179-404a-97a7-bf749934d047", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1726752963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639d35cc656e4dae8c062e531e6d2dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29928bd0-ae", "ovs_interfaceid": "29928bd0-ae23-4a93-ba76-d4df44512908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:11:36 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:36 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1232359904',display_name='tempest-TestVolumeSwap-server-1232359904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1232359904',id=8,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2ENTFsk1b8HIVp/AjEQRdBuwHgklGMstN4pfY6/Nxsx2xIO27pLswQtUZ4iPE5KKNau4+ayjWkgCf15tx1cX9NLf4vSR+GwHSqaV2xK6qDVN5umFrWsodM6q65GZ1Qvw==',key_name='tempest-keypair-1410286134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='639d35cc656e4dae8c062e531e6d2dc4',ramdisk_id='',reservation_id='r-9oc8eyer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-317282149',owner_user_name='tempest-TestVolumeSwap-317282149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b741b81c8ee4de19841fa3ae911bc1c',uuid=700d80d6-9248-4d6f-9010-c3904d8fec2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29928bd0-ae23-4a93-ba76-d4df44512908", "address": "fa:16:3e:35:f3:1f", "network": {"id": "9e4d5fcf-1179-404a-97a7-bf749934d047", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1726752963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639d35cc656e4dae8c062e531e6d2dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29928bd0-ae", "ovs_interfaceid": "29928bd0-ae23-4a93-ba76-d4df44512908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Converting VIF {"id": "29928bd0-ae23-4a93-ba76-d4df44512908", "address": "fa:16:3e:35:f3:1f", "network": {"id": "9e4d5fcf-1179-404a-97a7-bf749934d047", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1726752963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639d35cc656e4dae8c062e531e6d2dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29928bd0-ae", "ovs_interfaceid": "29928bd0-ae23-4a93-ba76-d4df44512908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=29928bd0-ae23-4a93-ba76-d4df44512908,network=Network(9e4d5fcf-1179-404a-97a7-bf749934d047),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29928bd0-ae') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.objects.instance [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lazy-loading 'pci_devices' on Instance uuid 700d80d6-9248-4d6f-9010-c3904d8fec2c {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.network.neutron [req-a8d7668e-8fc4-4cf8-ac0b-3ea8c43f4101 req-e87d747b-5492-4157-a1f8-d6d8cd25fbc8 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Updated VIF entry in instance network info cache for port 4607d653-6d85-46b9-b00e-39748d9afb78. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:11:36 user nova-compute[72447]: DEBUG nova.network.neutron [req-a8d7668e-8fc4-4cf8-ac0b-3ea8c43f4101 req-e87d747b-5492-4157-a1f8-d6d8cd25fbc8 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Updating instance_info_cache with network_info: [{"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:11:37 user nova-compute[72447]:   <uuid>700d80d6-9248-4d6f-9010-c3904d8fec2c</uuid>
Jul 31 12:11:37 user nova-compute[72447]:   <name>instance-00000008</name>
Jul 31 12:11:37 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:11:37 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:11:37 user nova-compute[72447]:   <metadata>
Jul 31 12:11:37 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:11:37 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:11:37 user nova-compute[72447]:       <nova:name>tempest-TestVolumeSwap-server-1232359904</nova:name>
Jul 31 12:11:37 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:11:36</nova:creationTime>
Jul 31 12:11:37 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:11:37 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:11:37 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:11:37 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:11:37 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:11:37 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:11:37 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:11:37 user nova-compute[72447]:       <nova:owner>
Jul 31 12:11:37 user nova-compute[72447]:         <nova:user uuid="4b741b81c8ee4de19841fa3ae911bc1c">tempest-TestVolumeSwap-317282149-project-member</nova:user>
Jul 31 12:11:37 user nova-compute[72447]:         <nova:project uuid="639d35cc656e4dae8c062e531e6d2dc4">tempest-TestVolumeSwap-317282149</nova:project>
Jul 31 12:11:37 user nova-compute[72447]:       </nova:owner>
Jul 31 12:11:37 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:11:37 user nova-compute[72447]:       <nova:ports>
Jul 31 12:11:37 user nova-compute[72447]:         <nova:port uuid="29928bd0-ae23-4a93-ba76-d4df44512908">
Jul 31 12:11:37 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 12:11:37 user nova-compute[72447]:         </nova:port>
Jul 31 12:11:37 user nova-compute[72447]:       </nova:ports>
Jul 31 12:11:37 user nova-compute[72447]:     </nova:instance>
Jul 31 12:11:37 user nova-compute[72447]:   </metadata>
Jul 31 12:11:37 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:11:37 user nova-compute[72447]:     <system>
Jul 31 12:11:37 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:11:37 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:11:37 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:11:37 user nova-compute[72447]:       <entry name="serial">700d80d6-9248-4d6f-9010-c3904d8fec2c</entry>
Jul 31 12:11:37 user nova-compute[72447]:       <entry name="uuid">700d80d6-9248-4d6f-9010-c3904d8fec2c</entry>
Jul 31 12:11:37 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:11:37 user nova-compute[72447]:     </system>
Jul 31 12:11:37 user nova-compute[72447]:   </sysinfo>
Jul 31 12:11:37 user nova-compute[72447]:   <os>
Jul 31 12:11:37 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:11:37 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:11:37 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:11:37 user nova-compute[72447]:   </os>
Jul 31 12:11:37 user nova-compute[72447]:   <features>
Jul 31 12:11:37 user nova-compute[72447]:     <acpi/>
Jul 31 12:11:37 user nova-compute[72447]:     <apic/>
Jul 31 12:11:37 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:11:37 user nova-compute[72447]:   </features>
Jul 31 12:11:37 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:11:37 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:11:37 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:11:37 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:11:37 user nova-compute[72447]:   </clock>
Jul 31 12:11:37 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:11:37 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:11:37 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:11:37 user nova-compute[72447]:   </cpu>
Jul 31 12:11:37 user nova-compute[72447]:   <devices>
Jul 31 12:11:37 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:11:37 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:11:37 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk"/>
Jul 31 12:11:37 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:11:37 user nova-compute[72447]:     </disk>
Jul 31 12:11:37 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:11:37 user nova-compute[72447]:       <mac address="fa:16:3e:35:f3:1f"/>
Jul 31 12:11:37 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:37 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:11:37 user nova-compute[72447]:       <target dev="tap29928bd0-ae"/>
Jul 31 12:11:37 user nova-compute[72447]:     </interface>
Jul 31 12:11:37 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:11:37 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/console.log" append="off"/>
Jul 31 12:11:37 user nova-compute[72447]:     </serial>
Jul 31 12:11:37 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:11:37 user nova-compute[72447]:     <video>
Jul 31 12:11:37 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:37 user nova-compute[72447]:     </video>
Jul 31 12:11:37 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:11:37 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:11:37 user nova-compute[72447]:     </rng>
Jul 31 12:11:37 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:11:37 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:11:37 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:11:37 user nova-compute[72447]:     </memballoon>
Jul 31 12:11:37 user nova-compute[72447]:   </devices>
Jul 31 12:11:37 user nova-compute[72447]: </domain>
Jul 31 12:11:37 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1232359904',display_name='tempest-TestVolumeSwap-server-1232359904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1232359904',id=8,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2ENTFsk1b8HIVp/AjEQRdBuwHgklGMstN4pfY6/Nxsx2xIO27pLswQtUZ4iPE5KKNau4+ayjWkgCf15tx1cX9NLf4vSR+GwHSqaV2xK6qDVN5umFrWsodM6q65GZ1Qvw==',key_name='tempest-keypair-1410286134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='639d35cc656e4dae8c062e531e6d2dc4',ramdisk_id='',reservation_id='r-9oc8eyer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-317282149',owner_user_name='tempest-TestVolumeSwap-317282149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b741b81c8ee4de19841fa3ae911bc1c',uuid=700d80d6-9248-4d6f-9010-c3904d8fec2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29928bd0-ae23-4a93-ba76-d4df44512908", "address": "fa:16:3e:35:f3:1f", "network": {"id": "9e4d5fcf-1179-404a-97a7-bf749934d047", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1726752963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639d35cc656e4dae8c062e531e6d2dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29928bd0-ae", "ovs_interfaceid": "29928bd0-ae23-4a93-ba76-d4df44512908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Converting VIF {"id": "29928bd0-ae23-4a93-ba76-d4df44512908", "address": "fa:16:3e:35:f3:1f", "network": {"id": "9e4d5fcf-1179-404a-97a7-bf749934d047", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1726752963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639d35cc656e4dae8c062e531e6d2dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29928bd0-ae", "ovs_interfaceid": "29928bd0-ae23-4a93-ba76-d4df44512908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=29928bd0-ae23-4a93-ba76-d4df44512908,network=Network(9e4d5fcf-1179-404a-97a7-bf749934d047),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29928bd0-ae') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG os_vif [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=29928bd0-ae23-4a93-ba76-d4df44512908,network=Network(9e4d5fcf-1179-404a-97a7-bf749934d047),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29928bd0-ae') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a8d7668e-8fc4-4cf8-ac0b-3ea8c43f4101 req-e87d747b-5492-4157-a1f8-d6d8cd25fbc8 service nova] Releasing lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-44566d86-7acc-411b-bf51-2fee14a8e629 req-cc54eee7-5769-4864-9346-2a04606a61ce service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Received event network-vif-plugged-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-44566d86-7acc-411b-bf51-2fee14a8e629 req-cc54eee7-5769-4864-9346-2a04606a61ce service nova] Acquiring lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-44566d86-7acc-411b-bf51-2fee14a8e629 req-cc54eee7-5769-4864-9346-2a04606a61ce service nova] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-44566d86-7acc-411b-bf51-2fee14a8e629 req-cc54eee7-5769-4864-9346-2a04606a61ce service nova] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-44566d86-7acc-411b-bf51-2fee14a8e629 req-cc54eee7-5769-4864-9346-2a04606a61ce service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] No waiting events found dispatching network-vif-plugged-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:37 user nova-compute[72447]: WARNING nova.compute.manager [req-44566d86-7acc-411b-bf51-2fee14a8e629 req-cc54eee7-5769-4864-9346-2a04606a61ce service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Received unexpected event network-vif-plugged-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 for instance with vm_state building and task_state spawning.
Jul 31 12:11:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29928bd0-ae, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29928bd0-ae, col_values=(('external_ids', {'iface-id': '29928bd0-ae23-4a93-ba76-d4df44512908', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:f3:1f', 'vm-uuid': '700d80d6-9248-4d6f-9010-c3904d8fec2c'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:37 user nova-compute[72447]: INFO os_vif [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=29928bd0-ae23-4a93-ba76-d4df44512908,network=Network(9e4d5fcf-1179-404a-97a7-bf749934d047),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29928bd0-ae')
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] No VIF found with MAC fa:16:3e:35:f3:1f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805497.1413915, fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:37 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] VM Resumed (Lifecycle Event)
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:11:37 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Instance spawned successfully.
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:37 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805497.14889, fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:37 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] VM Started (Lifecycle Event)
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:37 user nova-compute[72447]: INFO nova.compute.manager [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Took 9.67 seconds to spawn the instance on the hypervisor.
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:37 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:37 user nova-compute[72447]: INFO nova.compute.manager [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Took 10.72 seconds to build instance.
Jul 31 12:11:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afa05706-c96b-4435-bbb6-4161d335fdce tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.900s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.network.neutron [req-4cde5cd3-0fb7-4850-9760-9113d4b4230b req-d369988b-727c-4fb3-9ae2-1af17d72d816 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Updated VIF entry in instance network info cache for port 29928bd0-ae23-4a93-ba76-d4df44512908. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG nova.network.neutron [req-4cde5cd3-0fb7-4850-9760-9113d4b4230b req-d369988b-727c-4fb3-9ae2-1af17d72d816 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Updating instance_info_cache with network_info: [{"id": "29928bd0-ae23-4a93-ba76-d4df44512908", "address": "fa:16:3e:35:f3:1f", "network": {"id": "9e4d5fcf-1179-404a-97a7-bf749934d047", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1726752963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639d35cc656e4dae8c062e531e6d2dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29928bd0-ae", "ovs_interfaceid": "29928bd0-ae23-4a93-ba76-d4df44512908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4cde5cd3-0fb7-4850-9760-9113d4b4230b req-d369988b-727c-4fb3-9ae2-1af17d72d816 service nova] Releasing lock "refresh_cache-700d80d6-9248-4d6f-9010-c3904d8fec2c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] There are 0 instances to clean {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72447) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG nova.compute.manager [req-cab09341-5133-422c-9903-770777d5f314 req-8c2c7e09-e687-4142-a73a-552efef603a5 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-vif-plugged-4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cab09341-5133-422c-9903-770777d5f314 req-8c2c7e09-e687-4142-a73a-552efef603a5 service nova] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cab09341-5133-422c-9903-770777d5f314 req-8c2c7e09-e687-4142-a73a-552efef603a5 service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cab09341-5133-422c-9903-770777d5f314 req-8c2c7e09-e687-4142-a73a-552efef603a5 service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG nova.compute.manager [req-cab09341-5133-422c-9903-770777d5f314 req-8c2c7e09-e687-4142-a73a-552efef603a5 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] No waiting events found dispatching network-vif-plugged-4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:39 user nova-compute[72447]: WARNING nova.compute.manager [req-cab09341-5133-422c-9903-770777d5f314 req-8c2c7e09-e687-4142-a73a-552efef603a5 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received unexpected event network-vif-plugged-4607d653-6d85-46b9-b00e-39748d9afb78 for instance with vm_state building and task_state spawning.
Jul 31 12:11:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG nova.compute.manager [req-7f5b8526-7537-4479-8a23-50536253aaf7 req-589a409b-9573-42ff-8daf-0d6979592cdd service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-vif-plugged-4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7f5b8526-7537-4479-8a23-50536253aaf7 req-589a409b-9573-42ff-8daf-0d6979592cdd service nova] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7f5b8526-7537-4479-8a23-50536253aaf7 req-589a409b-9573-42ff-8daf-0d6979592cdd service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7f5b8526-7537-4479-8a23-50536253aaf7 req-589a409b-9573-42ff-8daf-0d6979592cdd service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG nova.compute.manager [req-7f5b8526-7537-4479-8a23-50536253aaf7 req-589a409b-9573-42ff-8daf-0d6979592cdd service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] No waiting events found dispatching network-vif-plugged-4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:41 user nova-compute[72447]: WARNING nova.compute.manager [req-7f5b8526-7537-4479-8a23-50536253aaf7 req-589a409b-9573-42ff-8daf-0d6979592cdd service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received unexpected event network-vif-plugged-4607d653-6d85-46b9-b00e-39748d9afb78 for instance with vm_state building and task_state spawning.
Jul 31 12:11:41 user nova-compute[72447]: DEBUG nova.compute.manager [req-7f5b8526-7537-4479-8a23-50536253aaf7 req-589a409b-9573-42ff-8daf-0d6979592cdd service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Received event network-vif-plugged-29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7f5b8526-7537-4479-8a23-50536253aaf7 req-589a409b-9573-42ff-8daf-0d6979592cdd service nova] Acquiring lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7f5b8526-7537-4479-8a23-50536253aaf7 req-589a409b-9573-42ff-8daf-0d6979592cdd service nova] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7f5b8526-7537-4479-8a23-50536253aaf7 req-589a409b-9573-42ff-8daf-0d6979592cdd service nova] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG nova.compute.manager [req-7f5b8526-7537-4479-8a23-50536253aaf7 req-589a409b-9573-42ff-8daf-0d6979592cdd service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] No waiting events found dispatching network-vif-plugged-29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:41 user nova-compute[72447]: WARNING nova.compute.manager [req-7f5b8526-7537-4479-8a23-50536253aaf7 req-589a409b-9573-42ff-8daf-0d6979592cdd service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Received unexpected event network-vif-plugged-29928bd0-ae23-4a93-ba76-d4df44512908 for instance with vm_state building and task_state spawning.
Jul 31 12:11:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:11:41 user nova-compute[72447]: INFO nova.compute.claims [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Claim successful on node user
Jul 31 12:11:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805502.328575, 700d80d6-9248-4d6f-9010-c3904d8fec2c => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] VM Resumed (Lifecycle Event)
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Instance spawned successfully.
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805502.3425083, 700d80d6-9248-4d6f-9010-c3904d8fec2c => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] VM Started (Lifecycle Event)
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Instance spawned successfully.
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805502.417831, b8929e20-a1f2-4a9c-a0c8-e0241113f0af => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] VM Resumed (Lifecycle Event)
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.compute.manager [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Took 10.54 seconds to spawn the instance on the hypervisor.
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805502.4229262, b8929e20-a1f2-4a9c-a0c8-e0241113f0af => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] VM Started (Lifecycle Event)
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.compute.manager [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Took 11.52 seconds to spawn the instance on the hypervisor.
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.policy [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6017d502501b4f688268466fc29beed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36cca759ce84e3a8d8a1c33cba6a2ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.compute.manager [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Took 12.50 seconds to build instance.
Jul 31 12:11:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-83495385-9c91-4cf0-b1f3-2fa4e9be5ab1 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.804s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Creating image(s)
Jul 31 12:11:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "/opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "/opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:42 user nova-compute[72447]: INFO nova.compute.manager [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Took 12.95 seconds to build instance.
Jul 31 12:11:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f2e7f243-59a6-4e4a-8ecb-a4991a513b68 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.122s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.199s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk 1073741824" returned: 0 in 0.087s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Skipping network cache update for instance because it is Building. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.181s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Successfully created port: 5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Cannot resize image /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lazy-loading 'migration_context' on Instance uuid b2cab306-7667-47cf-a689-75ad6d6b5dc3 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Ensure instance console log exists: /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.compute.manager [req-d8e16b18-42c9-4430-982a-ad1664847797 req-4bafc46c-92b6-41d0-a28d-572e2162a13f service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Received event network-vif-plugged-29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d8e16b18-42c9-4430-982a-ad1664847797 req-4bafc46c-92b6-41d0-a28d-572e2162a13f service nova] Acquiring lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d8e16b18-42c9-4430-982a-ad1664847797 req-4bafc46c-92b6-41d0-a28d-572e2162a13f service nova] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d8e16b18-42c9-4430-982a-ad1664847797 req-4bafc46c-92b6-41d0-a28d-572e2162a13f service nova] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:43 user nova-compute[72447]: DEBUG nova.compute.manager [req-d8e16b18-42c9-4430-982a-ad1664847797 req-4bafc46c-92b6-41d0-a28d-572e2162a13f service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] No waiting events found dispatching network-vif-plugged-29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:43 user nova-compute[72447]: WARNING nova.compute.manager [req-d8e16b18-42c9-4430-982a-ad1664847797 req-4bafc46c-92b6-41d0-a28d-572e2162a13f service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Received unexpected event network-vif-plugged-29928bd0-ae23-4a93-ba76-d4df44512908 for instance with vm_state active and task_state None.
Jul 31 12:11:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updating instance_info_cache with network_info: [{"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:44 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Successfully updated port: 5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "refresh_cache-b2cab306-7667-47cf-a689-75ad6d6b5dc3" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquired lock "refresh_cache-b2cab306-7667-47cf-a689-75ad6d6b5dc3" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-55244034-62ec-47f5-93bc-ea7dc66e660f req-89798635-a545-4c18-a29f-f6437c51d932 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Received event network-changed-5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-55244034-62ec-47f5-93bc-ea7dc66e660f req-89798635-a545-4c18-a29f-f6437c51d932 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Refreshing instance network info cache due to event network-changed-5003425a-134e-472d-92e2-420de67a84e7. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-55244034-62ec-47f5-93bc-ea7dc66e660f req-89798635-a545-4c18-a29f-f6437c51d932 service nova] Acquiring lock "refresh_cache-b2cab306-7667-47cf-a689-75ad6d6b5dc3" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Updating instance_info_cache with network_info: [{"id": "5003425a-134e-472d-92e2-420de67a84e7", "address": "fa:16:3e:64:3f:7e", "network": {"id": "31deefaf-d6e3-4bbf-8398-236aecf427d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-89341723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36cca759ce84e3a8d8a1c33cba6a2ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5003425a-13", "ovs_interfaceid": "5003425a-134e-472d-92e2-420de67a84e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Releasing lock "refresh_cache-b2cab306-7667-47cf-a689-75ad6d6b5dc3" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Instance network_info: |[{"id": "5003425a-134e-472d-92e2-420de67a84e7", "address": "fa:16:3e:64:3f:7e", "network": {"id": "31deefaf-d6e3-4bbf-8398-236aecf427d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-89341723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36cca759ce84e3a8d8a1c33cba6a2ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5003425a-13", "ovs_interfaceid": "5003425a-134e-472d-92e2-420de67a84e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-55244034-62ec-47f5-93bc-ea7dc66e660f req-89798635-a545-4c18-a29f-f6437c51d932 service nova] Acquired lock "refresh_cache-b2cab306-7667-47cf-a689-75ad6d6b5dc3" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.network.neutron [req-55244034-62ec-47f5-93bc-ea7dc66e660f req-89798635-a545-4c18-a29f-f6437c51d932 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Refreshing network info cache for port 5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Start _get_guest_xml network_info=[{"id": "5003425a-134e-472d-92e2-420de67a84e7", "address": "fa:16:3e:64:3f:7e", "network": {"id": "31deefaf-d6e3-4bbf-8398-236aecf427d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-89341723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36cca759ce84e3a8d8a1c33cba6a2ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5003425a-13", "ovs_interfaceid": "5003425a-134e-472d-92e2-420de67a84e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:11:46 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:46 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1464141448',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1464141448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1464141',id=9,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzSRwdrS7HFcVV/AUQVpHoJOv7VZB5uyZ1XrnyY4Q9qfsW+DAE3QAy0BH6WvHFSf1g39nN1pNtPujRp9pTX1hKRjCoGQFIItj14ZArSmfVcUJ8nuwntRhG9Xm94hyfJdg==',key_name='tempest-keypair-734771203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e36cca759ce84e3a8d8a1c33cba6a2ef',ramdisk_id='',reservation_id='r-mzb42qdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-118107813',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6017d502501b4f688268466fc29beed7',uuid=b2cab306-7667-47cf-a689-75ad6d6b5dc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5003425a-134e-472d-92e2-420de67a84e7", "address": "fa:16:3e:64:3f:7e", "network": {"id": "31deefaf-d6e3-4bbf-8398-236aecf427d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-89341723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36cca759ce84e3a8d8a1c33cba6a2ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5003425a-13", "ovs_interfaceid": "5003425a-134e-472d-92e2-420de67a84e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Converting VIF {"id": "5003425a-134e-472d-92e2-420de67a84e7", "address": "fa:16:3e:64:3f:7e", "network": {"id": "31deefaf-d6e3-4bbf-8398-236aecf427d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-89341723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36cca759ce84e3a8d8a1c33cba6a2ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5003425a-13", "ovs_interfaceid": "5003425a-134e-472d-92e2-420de67a84e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5003425a-134e-472d-92e2-420de67a84e7,network=Network(31deefaf-d6e3-4bbf-8398-236aecf427d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5003425a-13') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lazy-loading 'pci_devices' on Instance uuid b2cab306-7667-47cf-a689-75ad6d6b5dc3 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:11:46 user nova-compute[72447]:   <uuid>b2cab306-7667-47cf-a689-75ad6d6b5dc3</uuid>
Jul 31 12:11:46 user nova-compute[72447]:   <name>instance-00000009</name>
Jul 31 12:11:46 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:11:46 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:11:46 user nova-compute[72447]:   <metadata>
Jul 31 12:11:46 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:11:46 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:11:46 user nova-compute[72447]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1464141448</nova:name>
Jul 31 12:11:46 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:11:46</nova:creationTime>
Jul 31 12:11:46 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:11:46 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:11:46 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:11:46 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:11:46 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:11:46 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:11:46 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:11:46 user nova-compute[72447]:       <nova:owner>
Jul 31 12:11:46 user nova-compute[72447]:         <nova:user uuid="6017d502501b4f688268466fc29beed7">tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member</nova:user>
Jul 31 12:11:46 user nova-compute[72447]:         <nova:project uuid="e36cca759ce84e3a8d8a1c33cba6a2ef">tempest-TestServerVolumeAttachScenarioOldVersion-118107813</nova:project>
Jul 31 12:11:46 user nova-compute[72447]:       </nova:owner>
Jul 31 12:11:46 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:11:46 user nova-compute[72447]:       <nova:ports>
Jul 31 12:11:46 user nova-compute[72447]:         <nova:port uuid="5003425a-134e-472d-92e2-420de67a84e7">
Jul 31 12:11:46 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 12:11:46 user nova-compute[72447]:         </nova:port>
Jul 31 12:11:46 user nova-compute[72447]:       </nova:ports>
Jul 31 12:11:46 user nova-compute[72447]:     </nova:instance>
Jul 31 12:11:46 user nova-compute[72447]:   </metadata>
Jul 31 12:11:46 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:11:46 user nova-compute[72447]:     <system>
Jul 31 12:11:46 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:11:46 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:11:46 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:11:46 user nova-compute[72447]:       <entry name="serial">b2cab306-7667-47cf-a689-75ad6d6b5dc3</entry>
Jul 31 12:11:46 user nova-compute[72447]:       <entry name="uuid">b2cab306-7667-47cf-a689-75ad6d6b5dc3</entry>
Jul 31 12:11:46 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:11:46 user nova-compute[72447]:     </system>
Jul 31 12:11:46 user nova-compute[72447]:   </sysinfo>
Jul 31 12:11:46 user nova-compute[72447]:   <os>
Jul 31 12:11:46 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:11:46 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:11:46 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:11:46 user nova-compute[72447]:   </os>
Jul 31 12:11:46 user nova-compute[72447]:   <features>
Jul 31 12:11:46 user nova-compute[72447]:     <acpi/>
Jul 31 12:11:46 user nova-compute[72447]:     <apic/>
Jul 31 12:11:46 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:11:46 user nova-compute[72447]:   </features>
Jul 31 12:11:46 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:11:46 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:11:46 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:11:46 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:11:46 user nova-compute[72447]:   </clock>
Jul 31 12:11:46 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:11:46 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:11:46 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:11:46 user nova-compute[72447]:   </cpu>
Jul 31 12:11:46 user nova-compute[72447]:   <devices>
Jul 31 12:11:46 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:11:46 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:11:46 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk"/>
Jul 31 12:11:46 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:11:46 user nova-compute[72447]:     </disk>
Jul 31 12:11:46 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:11:46 user nova-compute[72447]:       <mac address="fa:16:3e:64:3f:7e"/>
Jul 31 12:11:46 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:46 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:11:46 user nova-compute[72447]:       <target dev="tap5003425a-13"/>
Jul 31 12:11:46 user nova-compute[72447]:     </interface>
Jul 31 12:11:46 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:11:46 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/console.log" append="off"/>
Jul 31 12:11:46 user nova-compute[72447]:     </serial>
Jul 31 12:11:46 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:11:46 user nova-compute[72447]:     <video>
Jul 31 12:11:46 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:46 user nova-compute[72447]:     </video>
Jul 31 12:11:46 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:11:46 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:11:46 user nova-compute[72447]:     </rng>
Jul 31 12:11:46 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:11:46 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:11:46 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:11:46 user nova-compute[72447]:     </memballoon>
Jul 31 12:11:46 user nova-compute[72447]:   </devices>
Jul 31 12:11:46 user nova-compute[72447]: </domain>
Jul 31 12:11:46 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1464141448',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1464141448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1464141',id=9,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzSRwdrS7HFcVV/AUQVpHoJOv7VZB5uyZ1XrnyY4Q9qfsW+DAE3QAy0BH6WvHFSf1g39nN1pNtPujRp9pTX1hKRjCoGQFIItj14ZArSmfVcUJ8nuwntRhG9Xm94hyfJdg==',key_name='tempest-keypair-734771203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e36cca759ce84e3a8d8a1c33cba6a2ef',ramdisk_id='',reservation_id='r-mzb42qdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-118107813',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6017d502501b4f688268466fc29beed7',uuid=b2cab306-7667-47cf-a689-75ad6d6b5dc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5003425a-134e-472d-92e2-420de67a84e7", "address": "fa:16:3e:64:3f:7e", "network": {"id": "31deefaf-d6e3-4bbf-8398-236aecf427d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-89341723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36cca759ce84e3a8d8a1c33cba6a2ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5003425a-13", "ovs_interfaceid": "5003425a-134e-472d-92e2-420de67a84e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Converting VIF {"id": "5003425a-134e-472d-92e2-420de67a84e7", "address": "fa:16:3e:64:3f:7e", "network": {"id": "31deefaf-d6e3-4bbf-8398-236aecf427d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-89341723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36cca759ce84e3a8d8a1c33cba6a2ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5003425a-13", "ovs_interfaceid": "5003425a-134e-472d-92e2-420de67a84e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5003425a-134e-472d-92e2-420de67a84e7,network=Network(31deefaf-d6e3-4bbf-8398-236aecf427d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5003425a-13') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG os_vif [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5003425a-134e-472d-92e2-420de67a84e7,network=Network(31deefaf-d6e3-4bbf-8398-236aecf427d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5003425a-13') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5003425a-13, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5003425a-13, col_values=(('external_ids', {'iface-id': '5003425a-134e-472d-92e2-420de67a84e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:3f:7e', 'vm-uuid': 'b2cab306-7667-47cf-a689-75ad6d6b5dc3'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:46 user nova-compute[72447]: INFO os_vif [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5003425a-134e-472d-92e2-420de67a84e7,network=Network(31deefaf-d6e3-4bbf-8398-236aecf427d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5003425a-13')
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] No VIF found with MAC fa:16:3e:64:3f:7e, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Acquiring lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:11:46 user nova-compute[72447]: INFO nova.compute.claims [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Claim successful on node user
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG nova.network.neutron [req-55244034-62ec-47f5-93bc-ea7dc66e660f req-89798635-a545-4c18-a29f-f6437c51d932 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Updated VIF entry in instance network info cache for port 5003425a-134e-472d-92e2-420de67a84e7. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG nova.network.neutron [req-55244034-62ec-47f5-93bc-ea7dc66e660f req-89798635-a545-4c18-a29f-f6437c51d932 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Updating instance_info_cache with network_info: [{"id": "5003425a-134e-472d-92e2-420de67a84e7", "address": "fa:16:3e:64:3f:7e", "network": {"id": "31deefaf-d6e3-4bbf-8398-236aecf427d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-89341723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36cca759ce84e3a8d8a1c33cba6a2ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5003425a-13", "ovs_interfaceid": "5003425a-134e-472d-92e2-420de67a84e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-55244034-62ec-47f5-93bc-ea7dc66e660f req-89798635-a545-4c18-a29f-f6437c51d932 service nova] Releasing lock "refresh_cache-b2cab306-7667-47cf-a689-75ad6d6b5dc3" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.945s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG nova.network.neutron [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:11:47 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:11:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG nova.policy [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2901cf34f3434675865d9fccd57b8f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e746fdc9b4a949985b20a9bf6c32a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:11:47 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Creating image(s)
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "/opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "/opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.169s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.207s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk 1073741824" returned: 0 in 0.079s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.network.neutron [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Successfully created port: 56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805510.8659694, b2cab306-7667-47cf-a689-75ad6d6b5dc3 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:51 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] VM Resumed (Lifecycle Event)
Jul 31 12:11:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-72459361-7737-4fde-a4a5-cf70b9a4c1c6 req-f2641c6b-dc11-4696-aaee-86c7b5f3eaeb service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Received event network-vif-plugged-5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-72459361-7737-4fde-a4a5-cf70b9a4c1c6 req-f2641c6b-dc11-4696-aaee-86c7b5f3eaeb service nova] Acquiring lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-72459361-7737-4fde-a4a5-cf70b9a4c1c6 req-f2641c6b-dc11-4696-aaee-86c7b5f3eaeb service nova] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-72459361-7737-4fde-a4a5-cf70b9a4c1c6 req-f2641c6b-dc11-4696-aaee-86c7b5f3eaeb service nova] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-72459361-7737-4fde-a4a5-cf70b9a4c1c6 req-f2641c6b-dc11-4696-aaee-86c7b5f3eaeb service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] No waiting events found dispatching network-vif-plugged-5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:51 user nova-compute[72447]: WARNING nova.compute.manager [req-72459361-7737-4fde-a4a5-cf70b9a4c1c6 req-f2641c6b-dc11-4696-aaee-86c7b5f3eaeb service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Received unexpected event network-vif-plugged-5003425a-134e-472d-92e2-420de67a84e7 for instance with vm_state building and task_state spawning.
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-3717fa71-d786-4536-a8e8-19f1c9b17200 req-7b5dc7f8-d875-4dc8-8d2d-9a72fc4f26a2 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Received event network-vif-plugged-5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3717fa71-d786-4536-a8e8-19f1c9b17200 req-7b5dc7f8-d875-4dc8-8d2d-9a72fc4f26a2 service nova] Acquiring lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3717fa71-d786-4536-a8e8-19f1c9b17200 req-7b5dc7f8-d875-4dc8-8d2d-9a72fc4f26a2 service nova] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3717fa71-d786-4536-a8e8-19f1c9b17200 req-7b5dc7f8-d875-4dc8-8d2d-9a72fc4f26a2 service nova] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-3717fa71-d786-4536-a8e8-19f1c9b17200 req-7b5dc7f8-d875-4dc8-8d2d-9a72fc4f26a2 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] No waiting events found dispatching network-vif-plugged-5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:51 user nova-compute[72447]: WARNING nova.compute.manager [req-3717fa71-d786-4536-a8e8-19f1c9b17200 req-7b5dc7f8-d875-4dc8-8d2d-9a72fc4f26a2 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Received unexpected event network-vif-plugged-5003425a-134e-472d-92e2-420de67a84e7 for instance with vm_state building and task_state spawning.
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 3.104s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:51 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:51 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7538MB free_disk=25.72814178466797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:51 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Instance spawned successfully.
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:11:51 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805510.8682864, b2cab306-7667-47cf-a689-75ad6d6b5dc3 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:51 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] VM Started (Lifecycle Event)
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:51 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Cannot resize image /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.objects.instance [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lazy-loading 'migration_context' on Instance uuid 5b461cf8-5cb4-4dff-9bba-20930ec4ee84 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:51 user nova-compute[72447]: INFO nova.compute.manager [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Took 9.04 seconds to spawn the instance on the hypervisor.
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Ensure instance console log exists: /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:51 user nova-compute[72447]: INFO nova.compute.manager [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Took 10.03 seconds to build instance.
Jul 31 12:11:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5654f255-1748-447c-ae0f-c20d54e8d5c1 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.127s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6c701045-e520-421f-94d2-b54edd0d5c54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance ba0c6dba-0035-4196-a05f-9335436fac86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 700d80d6-9248-4d6f-9010-c3904d8fec2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b2cab306-7667-47cf-a689-75ad6d6b5dc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 5b461cf8-5cb4-4dff-9bba-20930ec4ee84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing inventories for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating ProviderTree inventory for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing aggregate associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, aggregates: None {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing trait associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.network.neutron [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Successfully updated port: 56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Acquiring lock "refresh_cache-5b461cf8-5cb4-4dff-9bba-20930ec4ee84" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Acquired lock "refresh_cache-5b461cf8-5cb4-4dff-9bba-20930ec4ee84" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.network.neutron [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.network.neutron [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:11:52 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.403s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.network.neutron [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Updating instance_info_cache with network_info: [{"id": "56b68bf9-56ca-4ad8-831c-798ae286683a", "address": "fa:16:3e:d2:d0:b9", "network": {"id": "ef976ce1-87c7-4a27-83f0-cd3d764bdb86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464636439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e4e746fdc9b4a949985b20a9bf6c32a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b68bf9-56", "ovs_interfaceid": "56b68bf9-56ca-4ad8-831c-798ae286683a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Releasing lock "refresh_cache-5b461cf8-5cb4-4dff-9bba-20930ec4ee84" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Instance network_info: |[{"id": "56b68bf9-56ca-4ad8-831c-798ae286683a", "address": "fa:16:3e:d2:d0:b9", "network": {"id": "ef976ce1-87c7-4a27-83f0-cd3d764bdb86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464636439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e4e746fdc9b4a949985b20a9bf6c32a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b68bf9-56", "ovs_interfaceid": "56b68bf9-56ca-4ad8-831c-798ae286683a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Start _get_guest_xml network_info=[{"id": "56b68bf9-56ca-4ad8-831c-798ae286683a", "address": "fa:16:3e:d2:d0:b9", "network": {"id": "ef976ce1-87c7-4a27-83f0-cd3d764bdb86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464636439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e4e746fdc9b4a949985b20a9bf6c32a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b68bf9-56", "ovs_interfaceid": "56b68bf9-56ca-4ad8-831c-798ae286683a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:11:53 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:53 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1771091047',display_name='tempest-VolumesActionsTest-instance-1771091047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1771091047',id=10,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e4e746fdc9b4a949985b20a9bf6c32a',ramdisk_id='',reservation_id='r-ojrtj5kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-657810840',owner_user_name='tempest-VolumesActionsTest-657810840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:48Z,user_data=None,user_id='2901cf34f3434675865d9fccd57b8f20',uuid=5b461cf8-5cb4-4dff-9bba-20930ec4ee84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56b68bf9-56ca-4ad8-831c-798ae286683a", "address": "fa:16:3e:d2:d0:b9", "network": {"id": "ef976ce1-87c7-4a27-83f0-cd3d764bdb86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464636439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e4e746fdc9b4a949985b20a9bf6c32a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b68bf9-56", "ovs_interfaceid": "56b68bf9-56ca-4ad8-831c-798ae286683a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Converting VIF {"id": "56b68bf9-56ca-4ad8-831c-798ae286683a", "address": "fa:16:3e:d2:d0:b9", "network": {"id": "ef976ce1-87c7-4a27-83f0-cd3d764bdb86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464636439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e4e746fdc9b4a949985b20a9bf6c32a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b68bf9-56", "ovs_interfaceid": "56b68bf9-56ca-4ad8-831c-798ae286683a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:b9,bridge_name='br-int',has_traffic_filtering=True,id=56b68bf9-56ca-4ad8-831c-798ae286683a,network=Network(ef976ce1-87c7-4a27-83f0-cd3d764bdb86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b68bf9-56') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b461cf8-5cb4-4dff-9bba-20930ec4ee84 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.compute.manager [req-2aa1a8c2-bf0d-4ec7-a424-65901249749a req-32ddae3b-39be-4147-8e61-3d86186346f1 service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Received event network-changed-56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.compute.manager [req-2aa1a8c2-bf0d-4ec7-a424-65901249749a req-32ddae3b-39be-4147-8e61-3d86186346f1 service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Refreshing instance network info cache due to event network-changed-56b68bf9-56ca-4ad8-831c-798ae286683a. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2aa1a8c2-bf0d-4ec7-a424-65901249749a req-32ddae3b-39be-4147-8e61-3d86186346f1 service nova] Acquiring lock "refresh_cache-5b461cf8-5cb4-4dff-9bba-20930ec4ee84" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2aa1a8c2-bf0d-4ec7-a424-65901249749a req-32ddae3b-39be-4147-8e61-3d86186346f1 service nova] Acquired lock "refresh_cache-5b461cf8-5cb4-4dff-9bba-20930ec4ee84" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.network.neutron [req-2aa1a8c2-bf0d-4ec7-a424-65901249749a req-32ddae3b-39be-4147-8e61-3d86186346f1 service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Refreshing network info cache for port 56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:11:53 user nova-compute[72447]:   <uuid>5b461cf8-5cb4-4dff-9bba-20930ec4ee84</uuid>
Jul 31 12:11:53 user nova-compute[72447]:   <name>instance-0000000a</name>
Jul 31 12:11:53 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:11:53 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:11:53 user nova-compute[72447]:   <metadata>
Jul 31 12:11:53 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:11:53 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:11:53 user nova-compute[72447]:       <nova:name>tempest-VolumesActionsTest-instance-1771091047</nova:name>
Jul 31 12:11:53 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:11:53</nova:creationTime>
Jul 31 12:11:53 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:11:53 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:11:53 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:11:53 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:11:53 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:11:53 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:11:53 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:11:53 user nova-compute[72447]:       <nova:owner>
Jul 31 12:11:53 user nova-compute[72447]:         <nova:user uuid="2901cf34f3434675865d9fccd57b8f20">tempest-VolumesActionsTest-657810840-project-member</nova:user>
Jul 31 12:11:53 user nova-compute[72447]:         <nova:project uuid="0e4e746fdc9b4a949985b20a9bf6c32a">tempest-VolumesActionsTest-657810840</nova:project>
Jul 31 12:11:53 user nova-compute[72447]:       </nova:owner>
Jul 31 12:11:53 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:11:53 user nova-compute[72447]:       <nova:ports>
Jul 31 12:11:53 user nova-compute[72447]:         <nova:port uuid="56b68bf9-56ca-4ad8-831c-798ae286683a">
Jul 31 12:11:53 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:11:53 user nova-compute[72447]:         </nova:port>
Jul 31 12:11:53 user nova-compute[72447]:       </nova:ports>
Jul 31 12:11:53 user nova-compute[72447]:     </nova:instance>
Jul 31 12:11:53 user nova-compute[72447]:   </metadata>
Jul 31 12:11:53 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:11:53 user nova-compute[72447]:     <system>
Jul 31 12:11:53 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:11:53 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:11:53 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:11:53 user nova-compute[72447]:       <entry name="serial">5b461cf8-5cb4-4dff-9bba-20930ec4ee84</entry>
Jul 31 12:11:53 user nova-compute[72447]:       <entry name="uuid">5b461cf8-5cb4-4dff-9bba-20930ec4ee84</entry>
Jul 31 12:11:53 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:11:53 user nova-compute[72447]:     </system>
Jul 31 12:11:53 user nova-compute[72447]:   </sysinfo>
Jul 31 12:11:53 user nova-compute[72447]:   <os>
Jul 31 12:11:53 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:11:53 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:11:53 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:11:53 user nova-compute[72447]:   </os>
Jul 31 12:11:53 user nova-compute[72447]:   <features>
Jul 31 12:11:53 user nova-compute[72447]:     <acpi/>
Jul 31 12:11:53 user nova-compute[72447]:     <apic/>
Jul 31 12:11:53 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:11:53 user nova-compute[72447]:   </features>
Jul 31 12:11:53 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:11:53 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:11:53 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:11:53 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:11:53 user nova-compute[72447]:   </clock>
Jul 31 12:11:53 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:11:53 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:11:53 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:11:53 user nova-compute[72447]:   </cpu>
Jul 31 12:11:53 user nova-compute[72447]:   <devices>
Jul 31 12:11:53 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:11:53 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:11:53 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk"/>
Jul 31 12:11:53 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:11:53 user nova-compute[72447]:     </disk>
Jul 31 12:11:53 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:11:53 user nova-compute[72447]:       <mac address="fa:16:3e:d2:d0:b9"/>
Jul 31 12:11:53 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:53 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:11:53 user nova-compute[72447]:       <target dev="tap56b68bf9-56"/>
Jul 31 12:11:53 user nova-compute[72447]:     </interface>
Jul 31 12:11:53 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:11:53 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/console.log" append="off"/>
Jul 31 12:11:53 user nova-compute[72447]:     </serial>
Jul 31 12:11:53 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:11:53 user nova-compute[72447]:     <video>
Jul 31 12:11:53 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:11:53 user nova-compute[72447]:     </video>
Jul 31 12:11:53 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:11:53 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:11:53 user nova-compute[72447]:     </rng>
Jul 31 12:11:53 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:11:53 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:11:53 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:11:53 user nova-compute[72447]:     </memballoon>
Jul 31 12:11:53 user nova-compute[72447]:   </devices>
Jul 31 12:11:53 user nova-compute[72447]: </domain>
Jul 31 12:11:53 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1771091047',display_name='tempest-VolumesActionsTest-instance-1771091047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1771091047',id=10,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e4e746fdc9b4a949985b20a9bf6c32a',ramdisk_id='',reservation_id='r-ojrtj5kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-657810840',owner_user_name='tempest-VolumesActionsTest-657810840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:48Z,user_data=None,user_id='2901cf34f3434675865d9fccd57b8f20',uuid=5b461cf8-5cb4-4dff-9bba-20930ec4ee84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56b68bf9-56ca-4ad8-831c-798ae286683a", "address": "fa:16:3e:d2:d0:b9", "network": {"id": "ef976ce1-87c7-4a27-83f0-cd3d764bdb86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464636439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e4e746fdc9b4a949985b20a9bf6c32a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b68bf9-56", "ovs_interfaceid": "56b68bf9-56ca-4ad8-831c-798ae286683a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Converting VIF {"id": "56b68bf9-56ca-4ad8-831c-798ae286683a", "address": "fa:16:3e:d2:d0:b9", "network": {"id": "ef976ce1-87c7-4a27-83f0-cd3d764bdb86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464636439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e4e746fdc9b4a949985b20a9bf6c32a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b68bf9-56", "ovs_interfaceid": "56b68bf9-56ca-4ad8-831c-798ae286683a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:b9,bridge_name='br-int',has_traffic_filtering=True,id=56b68bf9-56ca-4ad8-831c-798ae286683a,network=Network(ef976ce1-87c7-4a27-83f0-cd3d764bdb86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b68bf9-56') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG os_vif [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:b9,bridge_name='br-int',has_traffic_filtering=True,id=56b68bf9-56ca-4ad8-831c-798ae286683a,network=Network(ef976ce1-87c7-4a27-83f0-cd3d764bdb86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b68bf9-56') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56b68bf9-56, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56b68bf9-56, col_values=(('external_ids', {'iface-id': '56b68bf9-56ca-4ad8-831c-798ae286683a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:d0:b9', 'vm-uuid': '5b461cf8-5cb4-4dff-9bba-20930ec4ee84'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:53 user nova-compute[72447]: INFO os_vif [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:b9,bridge_name='br-int',has_traffic_filtering=True,id=56b68bf9-56ca-4ad8-831c-798ae286683a,network=Network(ef976ce1-87c7-4a27-83f0-cd3d764bdb86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b68bf9-56')
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] No VIF found with MAC fa:16:3e:d2:d0:b9, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.network.neutron [req-2aa1a8c2-bf0d-4ec7-a424-65901249749a req-32ddae3b-39be-4147-8e61-3d86186346f1 service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Updated VIF entry in instance network info cache for port 56b68bf9-56ca-4ad8-831c-798ae286683a. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG nova.network.neutron [req-2aa1a8c2-bf0d-4ec7-a424-65901249749a req-32ddae3b-39be-4147-8e61-3d86186346f1 service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Updating instance_info_cache with network_info: [{"id": "56b68bf9-56ca-4ad8-831c-798ae286683a", "address": "fa:16:3e:d2:d0:b9", "network": {"id": "ef976ce1-87c7-4a27-83f0-cd3d764bdb86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464636439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e4e746fdc9b4a949985b20a9bf6c32a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b68bf9-56", "ovs_interfaceid": "56b68bf9-56ca-4ad8-831c-798ae286683a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2aa1a8c2-bf0d-4ec7-a424-65901249749a req-32ddae3b-39be-4147-8e61-3d86186346f1 service nova] Releasing lock "refresh_cache-5b461cf8-5cb4-4dff-9bba-20930ec4ee84" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:11:53 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:11:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:55 user nova-compute[72447]: DEBUG nova.compute.manager [req-6f9e3ef1-3a53-497c-9349-145b9f8073ef req-0cacd4b4-976c-45cd-bbcd-0fdf4936593b service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Received event network-vif-plugged-56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6f9e3ef1-3a53-497c-9349-145b9f8073ef req-0cacd4b4-976c-45cd-bbcd-0fdf4936593b service nova] Acquiring lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6f9e3ef1-3a53-497c-9349-145b9f8073ef req-0cacd4b4-976c-45cd-bbcd-0fdf4936593b service nova] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6f9e3ef1-3a53-497c-9349-145b9f8073ef req-0cacd4b4-976c-45cd-bbcd-0fdf4936593b service nova] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:55 user nova-compute[72447]: DEBUG nova.compute.manager [req-6f9e3ef1-3a53-497c-9349-145b9f8073ef req-0cacd4b4-976c-45cd-bbcd-0fdf4936593b service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] No waiting events found dispatching network-vif-plugged-56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:55 user nova-compute[72447]: WARNING nova.compute.manager [req-6f9e3ef1-3a53-497c-9349-145b9f8073ef req-0cacd4b4-976c-45cd-bbcd-0fdf4936593b service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Received unexpected event network-vif-plugged-56b68bf9-56ca-4ad8-831c-798ae286683a for instance with vm_state building and task_state spawning.
Jul 31 12:11:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-e9e3b5f6-b48b-4b69-8321-4af9f94f228c req-48a4f651-ac23-4406-a00d-14a0fc531d49 service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Received event network-vif-plugged-56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e9e3b5f6-b48b-4b69-8321-4af9f94f228c req-48a4f651-ac23-4406-a00d-14a0fc531d49 service nova] Acquiring lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e9e3b5f6-b48b-4b69-8321-4af9f94f228c req-48a4f651-ac23-4406-a00d-14a0fc531d49 service nova] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e9e3b5f6-b48b-4b69-8321-4af9f94f228c req-48a4f651-ac23-4406-a00d-14a0fc531d49 service nova] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-e9e3b5f6-b48b-4b69-8321-4af9f94f228c req-48a4f651-ac23-4406-a00d-14a0fc531d49 service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] No waiting events found dispatching network-vif-plugged-56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:11:57 user nova-compute[72447]: WARNING nova.compute.manager [req-e9e3b5f6-b48b-4b69-8321-4af9f94f228c req-48a4f651-ac23-4406-a00d-14a0fc531d49 service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Received unexpected event network-vif-plugged-56b68bf9-56ca-4ad8-831c-798ae286683a for instance with vm_state building and task_state spawning.
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805517.8856373, 5b461cf8-5cb4-4dff-9bba-20930ec4ee84 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:57 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] VM Resumed (Lifecycle Event)
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:11:57 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Instance spawned successfully.
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:11:57 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805517.8948631, 5b461cf8-5cb4-4dff-9bba-20930ec4ee84 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:11:57 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] VM Started (Lifecycle Event)
Jul 31 12:11:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:58 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:11:58 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:11:58 user nova-compute[72447]: INFO nova.compute.manager [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Took 10.12 seconds to spawn the instance on the hypervisor.
Jul 31 12:11:58 user nova-compute[72447]: DEBUG nova.compute.manager [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:11:58 user nova-compute[72447]: INFO nova.compute.manager [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Took 11.56 seconds to build instance.
Jul 31 12:11:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-652c77f3-ba55-4534-9db5-64739d7a2583 tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.684s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:11:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:11:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "52bef016-9676-446b-9a57-a43658e85e3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:12:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:07 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:12:07 user nova-compute[72447]: INFO nova.compute.claims [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Claim successful on node user
Jul 31 12:12:08 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:12:08 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:12:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:12:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:12:08 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:12:08 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:12:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:12:08 user nova-compute[72447]: INFO nova.virt.block_device [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Booting with volume ba3e9246-666a-4394-a2f8-598d2346dea7 at /dev/vda
Jul 31 12:12:08 user nova-compute[72447]: DEBUG os_brick.utils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:08 user nova-compute[72447]: INFO oslo.privsep.daemon [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp3jcqgzxm/privsep.sock']
Jul 31 12:12:08 user sudo[83482]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp3jcqgzxm/privsep.sock
Jul 31 12:12:08 user sudo[83482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 31 12:12:08 user nova-compute[72447]: DEBUG nova.policy [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '500bca482db546ae912239c23755545b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a73529ad58419e8a49be4f43148353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:12:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:09 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Successfully created port: fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:12:10 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Successfully created port: e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:12:10 user sudo[83482]: pam_unix(sudo:session): session closed for user root
Jul 31 12:12:10 user nova-compute[72447]: INFO oslo.privsep.daemon [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Spawned new privsep daemon via rootwrap
Jul 31 12:12:10 user nova-compute[72447]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 12:12:10 user nova-compute[72447]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 12:12:10 user nova-compute[72447]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 31 12:12:10 user nova-compute[72447]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83492
Jul 31 12:12:10 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deb67be-ca19-4dc0-8dfd-7a193265de07]: (2,) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8458f4-cc89-4a16-80a5-4e8691f1b5a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:11 user nova-compute[72447]: WARNING os_brick.initiator.connectors.nvmeof [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f3fbc5-1f6d-4815-9468-9d12925d87b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ffbb64-fb07-4039-9808-ea25dfe9d4a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ec405a-9a4f-4533-84c9-c5f63a6ffc08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:11 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:12:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac24f1f9-237e-4ca4-906f-72e0e95684f1]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG os_brick.utils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] <== get_connector_properties: return (2719ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating existing volume attachment record: f9bcc552-ee6f-458d-9b30-09ba0fd56cc6 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:12:11 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Successfully created port: 433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:12:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:12:12 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Successfully created port: bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:12:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:12:12 user nova-compute[72447]: INFO nova.compute.claims [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Claim successful on node user
Jul 31 12:12:12 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:12:12 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:12:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:12:13 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:12:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:12:13 user nova-compute[72447]: INFO nova.virt.block_device [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Booting with volume cbd46ce5-571b-4b5d-9f61-f20341cd8554 at /dev/vda
Jul 31 12:12:13 user nova-compute[72447]: DEBUG os_brick.utils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1d8411-dcea-467b-8428-8b1a8c1e6bf4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[149afedd-24e9-431a-a6bc-47261e85e12b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bff166-386f-4120-a15a-ff76c4337f4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0a65ab-4a74-4dbf-af80-a496f137dfe8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG nova.policy [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b71fe0a0a0a047b9bcdd3f50630b550c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88151ca93f3e49c1b60cba124db4eb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:13 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:12:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae87c402-4a6e-4799-b44b-0175d28c9bb1]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG os_brick.utils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating existing volume attachment record: c184ec4f-eee3-471f-95cc-f63990570ee1 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Successfully created port: 16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:12:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:14 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Successfully created port: 756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:12:15 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Successfully updated port: fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:15 user nova-compute[72447]: DEBUG nova.compute.manager [req-8c6fcf40-783b-4da2-a296-da1a7281d5c2 req-41b9bdac-acb7-4eb5-905d-b88a7bd006a5 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-changed-fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:15 user nova-compute[72447]: DEBUG nova.compute.manager [req-8c6fcf40-783b-4da2-a296-da1a7281d5c2 req-41b9bdac-acb7-4eb5-905d-b88a7bd006a5 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing instance network info cache due to event network-changed-fcc49a84-024d-42ad-a1fd-562c666a071d. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8c6fcf40-783b-4da2-a296-da1a7281d5c2 req-41b9bdac-acb7-4eb5-905d-b88a7bd006a5 service nova] Acquiring lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8c6fcf40-783b-4da2-a296-da1a7281d5c2 req-41b9bdac-acb7-4eb5-905d-b88a7bd006a5 service nova] Acquired lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:15 user nova-compute[72447]: DEBUG nova.network.neutron [req-8c6fcf40-783b-4da2-a296-da1a7281d5c2 req-41b9bdac-acb7-4eb5-905d-b88a7bd006a5 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing network info cache for port fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:15 user nova-compute[72447]: DEBUG nova.network.neutron [req-8c6fcf40-783b-4da2-a296-da1a7281d5c2 req-41b9bdac-acb7-4eb5-905d-b88a7bd006a5 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:12:15 user nova-compute[72447]: DEBUG nova.network.neutron [req-8c6fcf40-783b-4da2-a296-da1a7281d5c2 req-41b9bdac-acb7-4eb5-905d-b88a7bd006a5 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8c6fcf40-783b-4da2-a296-da1a7281d5c2 req-41b9bdac-acb7-4eb5-905d-b88a7bd006a5 service nova] Releasing lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:16 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Successfully created port: be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:12:17 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Successfully updated port: 0a08866a-ddc0-4637-a4f0-49fddc70fa85 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:17 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Successfully created port: 2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:12:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-995b4681-c6be-4477-8bc0-e553629305fe req-f3e4b7ca-bcb1-4c19-9ba6-20602bfdbbb3 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-changed-0a08866a-ddc0-4637-a4f0-49fddc70fa85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-995b4681-c6be-4477-8bc0-e553629305fe req-f3e4b7ca-bcb1-4c19-9ba6-20602bfdbbb3 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing instance network info cache due to event network-changed-0a08866a-ddc0-4637-a4f0-49fddc70fa85. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-995b4681-c6be-4477-8bc0-e553629305fe req-f3e4b7ca-bcb1-4c19-9ba6-20602bfdbbb3 service nova] Acquiring lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-995b4681-c6be-4477-8bc0-e553629305fe req-f3e4b7ca-bcb1-4c19-9ba6-20602bfdbbb3 service nova] Acquired lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:17 user nova-compute[72447]: DEBUG nova.network.neutron [req-995b4681-c6be-4477-8bc0-e553629305fe req-f3e4b7ca-bcb1-4c19-9ba6-20602bfdbbb3 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing network info cache for port 0a08866a-ddc0-4637-a4f0-49fddc70fa85 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:17 user nova-compute[72447]: DEBUG nova.network.neutron [req-995b4681-c6be-4477-8bc0-e553629305fe req-f3e4b7ca-bcb1-4c19-9ba6-20602bfdbbb3 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:12:17 user nova-compute[72447]: DEBUG nova.network.neutron [req-995b4681-c6be-4477-8bc0-e553629305fe req-f3e4b7ca-bcb1-4c19-9ba6-20602bfdbbb3 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-995b4681-c6be-4477-8bc0-e553629305fe req-f3e4b7ca-bcb1-4c19-9ba6-20602bfdbbb3 service nova] Releasing lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:19 user nova-compute[72447]: INFO nova.virt.block_device [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Booting with volume 4c4aab1b-840a-4240-890f-e1116b904621 at /dev/vdb
Jul 31 12:12:19 user nova-compute[72447]: DEBUG os_brick.utils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf075beb-f28c-44b8-a512-15c0dfa7978f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b0b867-0aaa-4a4c-a925-bc69db4ebe82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ad9b0-2953-4caa-bb01-70bf8abfb9d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caeaaf4-577b-4fdc-b32e-a9b44672519a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Successfully created port: c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Successfully updated port: 7ee2883e-7b34-4e10-afdf-ef20340172fb {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:19 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:12:19 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c22b22-82a2-4dc1-b27c-99cdc0853409]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG os_brick.utils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:19 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating existing volume attachment record: 9c20cccf-80fa-405e-9b0e-ec67b198fbc8 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:12:20 user nova-compute[72447]: DEBUG nova.compute.manager [req-e34b4d71-f0ea-45b3-b1a3-4d5a9b9207d6 req-615351ee-07b8-463f-a3f0-bba82e3ff5ea service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-changed-7ee2883e-7b34-4e10-afdf-ef20340172fb {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:20 user nova-compute[72447]: DEBUG nova.compute.manager [req-e34b4d71-f0ea-45b3-b1a3-4d5a9b9207d6 req-615351ee-07b8-463f-a3f0-bba82e3ff5ea service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing instance network info cache due to event network-changed-7ee2883e-7b34-4e10-afdf-ef20340172fb. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e34b4d71-f0ea-45b3-b1a3-4d5a9b9207d6 req-615351ee-07b8-463f-a3f0-bba82e3ff5ea service nova] Acquiring lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e34b4d71-f0ea-45b3-b1a3-4d5a9b9207d6 req-615351ee-07b8-463f-a3f0-bba82e3ff5ea service nova] Acquired lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:20 user nova-compute[72447]: DEBUG nova.network.neutron [req-e34b4d71-f0ea-45b3-b1a3-4d5a9b9207d6 req-615351ee-07b8-463f-a3f0-bba82e3ff5ea service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing network info cache for port 7ee2883e-7b34-4e10-afdf-ef20340172fb {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:20 user nova-compute[72447]: DEBUG nova.network.neutron [req-e34b4d71-f0ea-45b3-b1a3-4d5a9b9207d6 req-615351ee-07b8-463f-a3f0-bba82e3ff5ea service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:12:20 user nova-compute[72447]: DEBUG nova.network.neutron [req-e34b4d71-f0ea-45b3-b1a3-4d5a9b9207d6 req-615351ee-07b8-463f-a3f0-bba82e3ff5ea service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e34b4d71-f0ea-45b3-b1a3-4d5a9b9207d6 req-615351ee-07b8-463f-a3f0-bba82e3ff5ea service nova] Releasing lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:20 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Successfully created port: 254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:12:21 user nova-compute[72447]: INFO nova.virt.block_device [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Booting with volume f1614182-a45f-4cf6-85eb-e266aff12e33 at /dev/vdb
Jul 31 12:12:21 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Successfully updated port: e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG os_brick.utils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[66089f1e-38a8-48e6-b2bd-00622f416458]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff25342-6e78-4594-8f79-1dc27d13dc5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd48fc1-63ac-4c3a-b75b-eea9a6ee6707]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb37acff-25e6-4a54-9476-1870a3e01819]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:21 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:12:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f581836-537f-444f-92a1-08228a4516a4]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG os_brick.utils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:21 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating existing volume attachment record: 2ec699ea-2a81-4f0f-872d-8d83d9d6d0cf {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:12:22 user nova-compute[72447]: DEBUG nova.compute.manager [req-160e6aa0-c5b3-4fae-a6e4-cb78a2ec6695 req-4d915e3e-6332-49d2-9dec-598d129872ac service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-changed-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:22 user nova-compute[72447]: DEBUG nova.compute.manager [req-160e6aa0-c5b3-4fae-a6e4-cb78a2ec6695 req-4d915e3e-6332-49d2-9dec-598d129872ac service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing instance network info cache due to event network-changed-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-160e6aa0-c5b3-4fae-a6e4-cb78a2ec6695 req-4d915e3e-6332-49d2-9dec-598d129872ac service nova] Acquiring lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-160e6aa0-c5b3-4fae-a6e4-cb78a2ec6695 req-4d915e3e-6332-49d2-9dec-598d129872ac service nova] Acquired lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:22 user nova-compute[72447]: DEBUG nova.network.neutron [req-160e6aa0-c5b3-4fae-a6e4-cb78a2ec6695 req-4d915e3e-6332-49d2-9dec-598d129872ac service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing network info cache for port e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:22 user nova-compute[72447]: DEBUG nova.network.neutron [req-160e6aa0-c5b3-4fae-a6e4-cb78a2ec6695 req-4d915e3e-6332-49d2-9dec-598d129872ac service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:12:22 user nova-compute[72447]: DEBUG nova.network.neutron [req-160e6aa0-c5b3-4fae-a6e4-cb78a2ec6695 req-4d915e3e-6332-49d2-9dec-598d129872ac service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-160e6aa0-c5b3-4fae-a6e4-cb78a2ec6695 req-4d915e3e-6332-49d2-9dec-598d129872ac service nova] Releasing lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Successfully updated port: 756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Successfully updated port: 433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG nova.compute.manager [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-changed-756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG nova.compute.manager [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing instance network info cache due to event network-changed-756e0675-b763-4145-a0cf-d9f9f9cbe15d. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] Acquiring lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] Acquired lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG nova.network.neutron [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing network info cache for port 756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG nova.network.neutron [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Successfully updated port: c6f127c0-48e3-47d0-8596-e25666488558 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG nova.network.neutron [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] Releasing lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG nova.compute.manager [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-changed-433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG nova.compute.manager [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing instance network info cache due to event network-changed-433edca1-2807-4330-9b81-cadbecb3611a. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] Acquiring lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] Acquired lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG nova.network.neutron [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing network info cache for port 433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Successfully updated port: bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:24 user nova-compute[72447]: DEBUG nova.network.neutron [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:12:25 user nova-compute[72447]: DEBUG nova.network.neutron [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fcfb3652-baf5-40c4-82d1-04819f179e3c req-3c4bdeb8-5ebb-43de-a5de-d974c1d05827 service nova] Releasing lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Successfully updated port: 1e5180c3-e48d-4eed-953b-41b1fe9f9d22 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Successfully updated port: 16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquired lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-changed-c6f127c0-48e3-47d0-8596-e25666488558 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing instance network info cache due to event network-changed-c6f127c0-48e3-47d0-8596-e25666488558. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] Acquiring lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] Acquired lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing network info cache for port c6f127c0-48e3-47d0-8596-e25666488558 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] Releasing lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-changed-bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing instance network info cache due to event network-changed-bb8a12fd-f418-4a88-865b-e7569c051282. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] Acquiring lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:27 user nova-compute[72447]: INFO nova.virt.block_device [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Booting with volume 49bca79e-a9f2-486c-b313-7cadf2112925 at /dev/vdc
Jul 31 12:12:27 user nova-compute[72447]: DEBUG os_brick.utils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f952bc39-fc66-421e-be8c-2ba15e62c406]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f6c3e1-7c55-4b11-84b0-57452a3cc02e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5476d5c0-755e-4f14-9419-d9310307139e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7526d31-5793-4cdc-a900-8bc91f1b930d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:27 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:12:27 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d39858-ea6f-4744-a9c7-f1cdf15f47ad]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG os_brick.utils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:27 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating existing volume attachment record: 82ba4e2e-b803-43a9-914c-51e7d1696ba0 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:12:28 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Successfully updated port: be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-7d3890f7-3135-4118-a060-86fa6bd5ae1b req-8af67d84-0749-4c77-97f2-666129c62fe1 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-changed-be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-7d3890f7-3135-4118-a060-86fa6bd5ae1b req-8af67d84-0749-4c77-97f2-666129c62fe1 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing instance network info cache due to event network-changed-be660f99-0e0f-4622-8aa4-073606d35a33. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7d3890f7-3135-4118-a060-86fa6bd5ae1b req-8af67d84-0749-4c77-97f2-666129c62fe1 service nova] Acquiring lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7d3890f7-3135-4118-a060-86fa6bd5ae1b req-8af67d84-0749-4c77-97f2-666129c62fe1 service nova] Acquired lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:28 user nova-compute[72447]: DEBUG nova.network.neutron [req-7d3890f7-3135-4118-a060-86fa6bd5ae1b req-8af67d84-0749-4c77-97f2-666129c62fe1 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing network info cache for port be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:28 user nova-compute[72447]: DEBUG nova.network.neutron [req-7d3890f7-3135-4118-a060-86fa6bd5ae1b req-8af67d84-0749-4c77-97f2-666129c62fe1 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:12:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:28 user nova-compute[72447]: DEBUG nova.network.neutron [req-7d3890f7-3135-4118-a060-86fa6bd5ae1b req-8af67d84-0749-4c77-97f2-666129c62fe1 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7d3890f7-3135-4118-a060-86fa6bd5ae1b req-8af67d84-0749-4c77-97f2-666129c62fe1 service nova] Releasing lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Successfully updated port: 2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:29 user nova-compute[72447]: INFO nova.virt.block_device [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Booting with volume e5d76102-adcd-480c-a172-8eb1ea1f170f at /dev/vdc
Jul 31 12:12:29 user nova-compute[72447]: DEBUG os_brick.utils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[81589046-3d7a-4ceb-b046-4833caf33b10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[496c208f-96ac-4e4d-8110-f1c712197e14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5a8794-7786-413e-acb1-fe143e6b98c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a61013-615b-48c1-a6cf-9a9eff04b3f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:29 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:12:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[967cceb8-7586-4565-9e90-c374fc116512]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG os_brick.utils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:29 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating existing volume attachment record: 4e0a3a4e-c8f4-4e8a-96c5-0f970ff6a506 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG nova.network.neutron [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [{"id": "fcc49a84-024d-42ad-a1fd-562c666a071d", "address": "fa:16:3e:ba:1d:6f", "network": {"id": "014cf20a-a0cd-4676-a16c-05f5ded0bed9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1838211978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc49a84-02", "ovs_interfaceid": "fcc49a84-024d-42ad-a1fd-562c666a071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Releasing lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Instance network_info: |[{"id": "fcc49a84-024d-42ad-a1fd-562c666a071d", "address": "fa:16:3e:ba:1d:6f", "network": {"id": "014cf20a-a0cd-4676-a16c-05f5ded0bed9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1838211978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc49a84-02", "ovs_interfaceid": "fcc49a84-024d-42ad-a1fd-562c666a071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] Acquired lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing network info cache for port bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-cacf9d34-6701-45eb-ace4-aa6170bc1840 req-9cea3037-52bf-45ed-a5ea-aac280173fe4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-changed-2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-cacf9d34-6701-45eb-ace4-aa6170bc1840 req-9cea3037-52bf-45ed-a5ea-aac280173fe4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing instance network info cache due to event network-changed-2f72ad96-4cdb-40f6-b12d-99b8a787709c. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cacf9d34-6701-45eb-ace4-aa6170bc1840 req-9cea3037-52bf-45ed-a5ea-aac280173fe4 service nova] Acquiring lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cacf9d34-6701-45eb-ace4-aa6170bc1840 req-9cea3037-52bf-45ed-a5ea-aac280173fe4 service nova] Acquired lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG nova.network.neutron [req-cacf9d34-6701-45eb-ace4-aa6170bc1840 req-9cea3037-52bf-45ed-a5ea-aac280173fe4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing network info cache for port 2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG nova.network.neutron [req-cacf9d34-6701-45eb-ace4-aa6170bc1840 req-9cea3037-52bf-45ed-a5ea-aac280173fe4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG nova.network.neutron [req-cacf9d34-6701-45eb-ace4-aa6170bc1840 req-9cea3037-52bf-45ed-a5ea-aac280173fe4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cacf9d34-6701-45eb-ace4-aa6170bc1840 req-9cea3037-52bf-45ed-a5ea-aac280173fe4 service nova] Releasing lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Successfully updated port: c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updated VIF entry in instance network info cache for port bb8a12fd-f418-4a88-865b-e7569c051282. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:12:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [{"id": "fcc49a84-024d-42ad-a1fd-562c666a071d", "address": "fa:16:3e:ba:1d:6f", "network": {"id": "014cf20a-a0cd-4676-a16c-05f5ded0bed9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1838211978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc49a84-02", "ovs_interfaceid": "fcc49a84-024d-42ad-a1fd-562c666a071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] Releasing lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-changed-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing instance network info cache due to event network-changed-1e5180c3-e48d-4eed-953b-41b1fe9f9d22. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] Acquiring lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] Acquired lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing network info cache for port 1e5180c3-e48d-4eed-953b-41b1fe9f9d22 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] Releasing lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-changed-16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing instance network info cache due to event network-changed-16d5f5c4-8b11-4e78-b5ad-048300350e04. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] Acquiring lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] Acquired lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing network info cache for port 16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Successfully updated port: 254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquired lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updated VIF entry in instance network info cache for port 16d5f5c4-8b11-4e78-b5ad-048300350e04. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [{"id": "fcc49a84-024d-42ad-a1fd-562c666a071d", "address": "fa:16:3e:ba:1d:6f", "network": {"id": "014cf20a-a0cd-4676-a16c-05f5ded0bed9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1838211978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc49a84-02", "ovs_interfaceid": "fcc49a84-024d-42ad-a1fd-562c666a071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1bbcbd8-8311-4873-8681-d6fa5fe784f1 req-de4973ca-e75b-41d6-b04b-275806197150 service nova] Releasing lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG nova.compute.manager [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-changed-c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG nova.compute.manager [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing instance network info cache due to event network-changed-c2bd8892-ea08-477e-8aff-70be63dfe0e7. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] Acquiring lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.network.neutron [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating instance_info_cache with network_info: [{"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "254eff25-f6ed-48ae-b3e1-4474187862c3", "address": "fa:16:3e:64:d0:a8", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254eff25-f6", "ovs_interfaceid": "254eff25-f6ed-48ae-b3e1-4474187862c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Releasing lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Instance network_info: |[{"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "254eff25-f6ed-48ae-b3e1-4474187862c3", "address": "fa:16:3e:64:d0:a8", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254eff25-f6", "ovs_interfaceid": "254eff25-f6ed-48ae-b3e1-4474187862c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] Acquired lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.network.neutron [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing network info cache for port c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:12:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Creating image(s)
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Ensure instance console log exists: /opt/stack/data/nova/instances/52bef016-9676-446b-9a57-a43658e85e3c/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Start _get_guest_xml network_info=[{"id": "fcc49a84-024d-42ad-a1fd-562c666a071d", "address": "fa:16:3e:ba:1d:6f", "network": {"id": "014cf20a-a0cd-4676-a16c-05f5ded0bed9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1838211978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc49a84-02", "ovs_interfaceid": "fcc49a84-024d-42ad-a1fd-562c666a071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'f9bcc552-ee6f-458d-9b30-09ba0fd56cc6', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dATGulmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '52bef016-9676-446b-9a57-a43658e85e3c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba3e9246-666a-4394-a2f8-598d2346dea7', 'serial': 'ba3e9246-666a-4394-a2f8-598d2346dea7'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '9c20cccf-80fa-405e-9b0e-ec67b198fbc8', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKMsFilN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '52bef016-9676-446b-9a57-a43658e85e3c', 'attached_at': '', 'detached_at': '', 'volume_id': '4c4aab1b-840a-4240-890f-e1116b904621', 'serial': '4c4aab1b-840a-4240-890f-e1116b904621'}, 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '82ba4e2e-b803-43a9-914c-51e7d1696ba0', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxGPQHmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '52bef016-9676-446b-9a57-a43658e85e3c', 'attached_at': '', 'detached_at': '', 'volume_id': '49bca79e-a9f2-486c-b313-7cadf2112925', 'serial': '49bca79e-a9f2-486c-b313-7cadf2112925'}, 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:12:35 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:12:35 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connector [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Factory for ISCSI on None {{(pid=72447) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dATGulmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:35 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:12:35 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:12:35 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.network.neutron [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updated VIF entry in instance network info cache for port c2bd8892-ea08-477e-8aff-70be63dfe0e7. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.network.neutron [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating instance_info_cache with network_info: [{"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "254eff25-f6ed-48ae-b3e1-4474187862c3", "address": "fa:16:3e:64:d0:a8", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254eff25-f6", "ovs_interfaceid": "254eff25-f6ed-48ae-b3e1-4474187862c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffcdd2f-d6ca-4367-b8a9-06c6ba040052]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] Releasing lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-changed-254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing instance network info cache due to event network-changed-254eff25-f6ed-48ae-b3e1-4474187862c3. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] Acquiring lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] Acquired lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG nova.network.neutron [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing network info cache for port 254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:12:35 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7581ace5-7afc-4ae9-b087-be88d652bf45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7] added
Jul 31 12:12:35 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eda343-51cd-4a45-91f7-13a64b4e84e3]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[249686e7-6913-4787-8ebb-fbf56bef8932]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dATGulmF {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dATGulmF" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fd2036-1345-4551-9f0d-3fc513ac14d4]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dATGulmF'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c8c979-419d-4142-9d16-7bb44e28102e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[973a1137-14fd-492a-8568-a438926388a7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:12:35 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:12:35 user nova-compute[72447]:  {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:12:35 user nova-compute[72447]: WARNING os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 12:12:35 user nova-compute[72447]: 
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0813ef94-871b-4442-b3d9-58ce00761a76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7, portal: 172.16.0.220,3260]
Jul 31 12:12:35 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7, portal: 172.16.0.220,3260] successful.
Jul 31 12:12:35 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c74d67-7771-43e3-a887-83cebce126ac]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4660c5f-971a-4e82-8608-071daeeb2059]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:35 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:35 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[133dbb68-29b7-4a7b-a2da-af7b180df793]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:35 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG nova.network.neutron [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updated VIF entry in instance network info cache for port 254eff25-f6ed-48ae-b3e1-4474187862c3. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG nova.network.neutron [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating instance_info_cache with network_info: [{"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "254eff25-f6ed-48ae-b3e1-4474187862c3", "address": "fa:16:3e:64:d0:a8", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254eff25-f6", "ovs_interfaceid": "254eff25-f6ed-48ae-b3e1-4474187862c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-59aa96b5-1d4a-4efd-8ffc-56cdfd482f7c req-45546d88-7070-4a44-9a5c-a4184ad136e4 service nova] Releasing lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dATGulmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23730326435383839', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730326435383839', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKMsFilN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:36 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:12:36 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:12:36 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14d7fd3-f2c7-44d3-bf73-aa6b967b82cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:12:36 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f4a63d-a043-4f54-be9e-ac2c23e108e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621] added
Jul 31 12:12:36 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a37477-cfb2-4136-8732-9b48419f6d3e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4633c086-7d7f-42eb-be6f-9d41a68750d3]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKMsFilN {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKMsFilN" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9a9753-46be-4e9d-bff5-517af880150f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bKMsFilN'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8cc993-94fa-4a5a-99c3-14290e481d83]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[407dafd6-6005-4075-b95b-e7810e1a7fc3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:37 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:37 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e51389-5c3a-4c8c-bdfd-00adb6044151]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621, portal: 172.16.0.220,3260]
Jul 31 12:12:37 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621, portal: 172.16.0.220,3260] successful.
Jul 31 12:12:37 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[75270d11-869e-4c04-a309-504d6e79c6d7]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b04f0d9-37f5-4a96-8997-8ccfa353a106]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:37 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:37 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:37 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:37 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f840b085-3ac1-4d78-8a98-1161e9957928]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:12:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKMsFilN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26561383266613562', 'path': '/dev/sdc'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561383266613562', 'path': '/dev/sdc'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:12:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Creating image(s)
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Ensure instance console log exists: /opt/stack/data/nova/instances/8ddee7bd-86de-4bac-84c4-a8813ad9e985/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Start _get_guest_xml network_info=[{"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "254eff25-f6ed-48ae-b3e1-4474187862c3", "address": "fa:16:3e:64:d0:a8", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254eff25-f6", "ovs_interfaceid": "254eff25-f6ed-48ae-b3e1-4474187862c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'c184ec4f-eee3-471f-95cc-f63990570ee1', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUuxseqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ddee7bd-86de-4bac-84c4-a8813ad9e985', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbd46ce5-571b-4b5d-9f61-f20341cd8554', 'serial': 'cbd46ce5-571b-4b5d-9f61-f20341cd8554'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '2ec699ea-2a81-4f0f-872d-8d83d9d6d0cf', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bznVxWsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ddee7bd-86de-4bac-84c4-a8813ad9e985', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1614182-a45f-4cf6-85eb-e266aff12e33', 'serial': 'f1614182-a45f-4cf6-85eb-e266aff12e33'}, 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '4e0a3a4e-c8f4-4e8a-96c5-0f970ff6a506', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usfnFmvA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ddee7bd-86de-4bac-84c4-a8813ad9e985', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5d76102-adcd-480c-a172-8eb1ea1f170f', 'serial': 'e5d76102-adcd-480c-a172-8eb1ea1f170f'}, 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxGPQHmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:38 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:12:38 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:12:38 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:38 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:12:38 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUuxseqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:38 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8dad00-8eb0-4085-8745-2eb7fcd2157f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:12:38 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d188c3-bc24-4491-b1f6-8cf736902a31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925] added
Jul 31 12:12:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[45222602-7f24-4eb6-83d0-a79ef5e51896]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed28f32-4e26-41e4-b6d6-b95af73fd262]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxGPQHmW {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxGPQHmW" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedbfdb2-5527-438e-a331-2b8cf998af6d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yxGPQHmW'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8363de26-ee7b-400a-a3ef-896684147126]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af4ec3c-7bc3-4618-bb32-0314c89322c9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:38 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:38 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f657fcb-5dfa-44cd-bbef-146caf1befe0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925, portal: 172.16.0.220,3260]
Jul 31 12:12:38 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925, portal: 172.16.0.220,3260] successful.
Jul 31 12:12:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[911a30cd-e887-4b51-b80f-b89ac2611608]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dabcbc4-de80-48a0-a603-6d28c499f2d2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:38 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:38 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:38 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:38 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d41fa5-a92e-4994-beb8-95ef2e25c65f]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:38 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxGPQHmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23666636466323463', 'path': '/dev/sdd'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666636466323463', 'path': '/dev/sdd'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.268s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:12:39 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:12:39 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d9b8be-2ec6-4a8a-a21a-9fa0ff461363]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:12:39 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcc49a84-024d-42ad-a1fd-562c666a071d", "address": "fa:16:3e:ba:1d:6f", "network": {"id": "014cf20a-a0cd-4676-a16c-05f5ded0bed9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1838211978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc49a84-02", "ovs_interfaceid": "fcc49a84-024d-42ad-a1fd-562c666a071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "fcc49a84-024d-42ad-a1fd-562c666a071d", "address": "fa:16:3e:ba:1d:6f", "network": {"id": "014cf20a-a0cd-4676-a16c-05f5ded0bed9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1838211978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc49a84-02", "ovs_interfaceid": "fcc49a84-024d-42ad-a1fd-562c666a071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1d:6f,bridge_name='br-int',has_traffic_filtering=True,id=fcc49a84-024d-42ad-a1fd-562c666a071d,network=Network(014cf20a-a0cd-4676-a16c-05f5ded0bed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc49a84-02') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:3f:58,bridge_name='br-int',has_traffic_filtering=True,id=0a08866a-ddc0-4637-a4f0-49fddc70fa85,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a08866a-dd') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:96:18,bridge_name='br-int',has_traffic_filtering=True,id=7ee2883e-7b34-4e10-afdf-ef20340172fb,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee2883e-7b') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=e35b56c3-881b-4cc2-bb6f-bab121fbf7a5,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35b56c3-88') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:83:3a,bridge_name='br-int',has_traffic_filtering=True,id=433edca1-2807-4330-9b81-cadbecb3611a,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap433edca1-28') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:cc:65,bridge_name='br-int',has_traffic_filtering=True,id=bb8a12fd-f418-4a88-865b-e7569c051282,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8a12fd-f4') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7a:04,bridge_name='br-int',has_traffic_filtering=True,id=16d5f5c4-8b11-4e78-b5ad-048300350e04,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d5f5c4-8b') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.objects.instance [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lazy-loading 'pci_devices' on Instance uuid 52bef016-9676-446b-9a57-a43658e85e3c {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee32754-5b03-4b00-a02e-c75df50dffb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554] added
Jul 31 12:12:39 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:12:39 user nova-compute[72447]:   <uuid>52bef016-9676-446b-9a57-a43658e85e3c</uuid>
Jul 31 12:12:39 user nova-compute[72447]:   <name>instance-0000000b</name>
Jul 31 12:12:39 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:12:39 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:12:39 user nova-compute[72447]:   <metadata>
Jul 31 12:12:39 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:12:39 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:12:39 user nova-compute[72447]:       <nova:name>tempest-device-tagging-server-1140366605</nova:name>
Jul 31 12:12:39 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:12:35</nova:creationTime>
Jul 31 12:12:39 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:12:39 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:12:39 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:12:39 user nova-compute[72447]:       <nova:owner>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:user uuid="500bca482db546ae912239c23755545b">tempest-TaggedBootDevicesTest_v242-999702660-project-member</nova:user>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:project uuid="06a73529ad58419e8a49be4f43148353">tempest-TaggedBootDevicesTest_v242-999702660</nova:project>
Jul 31 12:12:39 user nova-compute[72447]:       </nova:owner>
Jul 31 12:12:39 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:12:39 user nova-compute[72447]:       <nova:ports>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:port uuid="fcc49a84-024d-42ad-a1fd-562c666a071d">
Jul 31 12:12:39 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 12:12:39 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:port uuid="0a08866a-ddc0-4637-a4f0-49fddc70fa85">
Jul 31 12:12:39 user nova-compute[72447]:           <nova:ip type="fixed" address="10.1.1.96" ipVersion="4"/>
Jul 31 12:12:39 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:port uuid="7ee2883e-7b34-4e10-afdf-ef20340172fb">
Jul 31 12:12:39 user nova-compute[72447]:           <nova:ip type="fixed" address="10.1.1.215" ipVersion="4"/>
Jul 31 12:12:39 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:port uuid="e35b56c3-881b-4cc2-bb6f-bab121fbf7a5">
Jul 31 12:12:39 user nova-compute[72447]:           <nova:ip type="fixed" address="10.1.1.224" ipVersion="4"/>
Jul 31 12:12:39 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:port uuid="433edca1-2807-4330-9b81-cadbecb3611a">
Jul 31 12:12:39 user nova-compute[72447]:           <nova:ip type="fixed" address="10.1.1.132" ipVersion="4"/>
Jul 31 12:12:39 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:port uuid="bb8a12fd-f418-4a88-865b-e7569c051282">
Jul 31 12:12:39 user nova-compute[72447]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 31 12:12:39 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:39 user nova-compute[72447]:         <nova:port uuid="16d5f5c4-8b11-4e78-b5ad-048300350e04">
Jul 31 12:12:39 user nova-compute[72447]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 31 12:12:39 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:39 user nova-compute[72447]:       </nova:ports>
Jul 31 12:12:39 user nova-compute[72447]:     </nova:instance>
Jul 31 12:12:39 user nova-compute[72447]:   </metadata>
Jul 31 12:12:39 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:12:39 user nova-compute[72447]:     <system>
Jul 31 12:12:39 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:12:39 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:12:39 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:12:39 user nova-compute[72447]:       <entry name="serial">52bef016-9676-446b-9a57-a43658e85e3c</entry>
Jul 31 12:12:39 user nova-compute[72447]:       <entry name="uuid">52bef016-9676-446b-9a57-a43658e85e3c</entry>
Jul 31 12:12:39 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:12:39 user nova-compute[72447]:     </system>
Jul 31 12:12:39 user nova-compute[72447]:   </sysinfo>
Jul 31 12:12:39 user nova-compute[72447]:   <os>
Jul 31 12:12:39 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:12:39 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:12:39 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:12:39 user nova-compute[72447]:   </os>
Jul 31 12:12:39 user nova-compute[72447]:   <features>
Jul 31 12:12:39 user nova-compute[72447]:     <acpi/>
Jul 31 12:12:39 user nova-compute[72447]:     <apic/>
Jul 31 12:12:39 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:12:39 user nova-compute[72447]:   </features>
Jul 31 12:12:39 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:12:39 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:12:39 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:12:39 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:12:39 user nova-compute[72447]:   </clock>
Jul 31 12:12:39 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:12:39 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:12:39 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:12:39 user nova-compute[72447]:   </cpu>
Jul 31 12:12:39 user nova-compute[72447]:   <devices>
Jul 31 12:12:39 user nova-compute[72447]:     <disk type="file" device="cdrom">
Jul 31 12:12:39 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 12:12:39 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/52bef016-9676-446b-9a57-a43658e85e3c/disk.config"/>
Jul 31 12:12:39 user nova-compute[72447]:       <target dev="hda" bus="ide"/>
Jul 31 12:12:39 user nova-compute[72447]:     </disk>
Jul 31 12:12:39 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:12:39 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:12:39 user nova-compute[72447]:       <source dev="/dev/sdb"/>
Jul 31 12:12:39 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:12:39 user nova-compute[72447]:       <serial>ba3e9246-666a-4394-a2f8-598d2346dea7</serial>
Jul 31 12:12:39 user nova-compute[72447]:     </disk>
Jul 31 12:12:39 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:12:39 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:12:39 user nova-compute[72447]:       <source dev="/dev/sdc"/>
Jul 31 12:12:39 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:12:39 user nova-compute[72447]:       <serial>4c4aab1b-840a-4240-890f-e1116b904621</serial>
Jul 31 12:12:39 user nova-compute[72447]:     </disk>
Jul 31 12:12:39 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:12:39 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:12:39 user nova-compute[72447]:       <source dev="/dev/sdd"/>
Jul 31 12:12:39 user nova-compute[72447]:       <target dev="vdc" bus="virtio"/>
Jul 31 12:12:39 user nova-compute[72447]:       <serial>49bca79e-a9f2-486c-b313-7cadf2112925</serial>
Jul 31 12:12:39 user nova-compute[72447]:     </disk>
Jul 31 12:12:39 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:39 user nova-compute[72447]:       <mac address="fa:16:3e:ba:1d:6f"/>
Jul 31 12:12:39 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:39 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:39 user nova-compute[72447]:       <target dev="tapfcc49a84-02"/>
Jul 31 12:12:39 user nova-compute[72447]:     </interface>
Jul 31 12:12:39 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:39 user nova-compute[72447]:       <mac address="fa:16:3e:29:3f:58"/>
Jul 31 12:12:39 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:39 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:39 user nova-compute[72447]:       <target dev="tap0a08866a-dd"/>
Jul 31 12:12:39 user nova-compute[72447]:     </interface>
Jul 31 12:12:39 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:39 user nova-compute[72447]:       <mac address="fa:16:3e:61:96:18"/>
Jul 31 12:12:39 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:39 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:39 user nova-compute[72447]:       <target dev="tap7ee2883e-7b"/>
Jul 31 12:12:39 user nova-compute[72447]:     </interface>
Jul 31 12:12:39 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:39 user nova-compute[72447]:       <mac address="fa:16:3e:a0:97:b1"/>
Jul 31 12:12:39 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:39 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:39 user nova-compute[72447]:       <target dev="tape35b56c3-88"/>
Jul 31 12:12:39 user nova-compute[72447]:     </interface>
Jul 31 12:12:39 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:39 user nova-compute[72447]:       <mac address="fa:16:3e:04:83:3a"/>
Jul 31 12:12:39 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:39 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:39 user nova-compute[72447]:       <target dev="tap433edca1-28"/>
Jul 31 12:12:39 user nova-compute[72447]:     </interface>
Jul 31 12:12:39 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:39 user nova-compute[72447]:       <mac address="fa:16:3e:df:cc:65"/>
Jul 31 12:12:39 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:39 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:39 user nova-compute[72447]:       <target dev="tapbb8a12fd-f4"/>
Jul 31 12:12:39 user nova-compute[72447]:     </interface>
Jul 31 12:12:39 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:39 user nova-compute[72447]:       <mac address="fa:16:3e:ac:7a:04"/>
Jul 31 12:12:39 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:39 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:39 user nova-compute[72447]:       <target dev="tap16d5f5c4-8b"/>
Jul 31 12:12:39 user nova-compute[72447]:     </interface>
Jul 31 12:12:39 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:12:39 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/52bef016-9676-446b-9a57-a43658e85e3c/console.log" append="off"/>
Jul 31 12:12:39 user nova-compute[72447]:     </serial>
Jul 31 12:12:39 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:12:39 user nova-compute[72447]:     <video>
Jul 31 12:12:39 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:39 user nova-compute[72447]:     </video>
Jul 31 12:12:39 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:12:39 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:12:39 user nova-compute[72447]:     </rng>
Jul 31 12:12:39 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:12:39 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:12:39 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:12:39 user nova-compute[72447]:     </memballoon>
Jul 31 12:12:39 user nova-compute[72447]:   </devices>
Jul 31 12:12:39 user nova-compute[72447]: </domain>
Jul 31 12:12:39 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcc49a84-024d-42ad-a1fd-562c666a071d", "address": "fa:16:3e:ba:1d:6f", "network": {"id": "014cf20a-a0cd-4676-a16c-05f5ded0bed9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1838211978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc49a84-02", "ovs_interfaceid": "fcc49a84-024d-42ad-a1fd-562c666a071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "fcc49a84-024d-42ad-a1fd-562c666a071d", "address": "fa:16:3e:ba:1d:6f", "network": {"id": "014cf20a-a0cd-4676-a16c-05f5ded0bed9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1838211978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc49a84-02", "ovs_interfaceid": "fcc49a84-024d-42ad-a1fd-562c666a071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1d:6f,bridge_name='br-int',has_traffic_filtering=True,id=fcc49a84-024d-42ad-a1fd-562c666a071d,network=Network(014cf20a-a0cd-4676-a16c-05f5ded0bed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc49a84-02') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1d:6f,bridge_name='br-int',has_traffic_filtering=True,id=fcc49a84-024d-42ad-a1fd-562c666a071d,network=Network(014cf20a-a0cd-4676-a16c-05f5ded0bed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc49a84-02') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcc49a84-02, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcc49a84-02, col_values=(('external_ids', {'iface-id': 'fcc49a84-024d-42ad-a1fd-562c666a071d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:1d:6f', 'vm-uuid': '52bef016-9676-446b-9a57-a43658e85e3c'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa51766-be3b-48b2-bc24-f6455de896e4]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[917a6a42-53ec-4b11-a33c-28e3d08c5a80]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yUuxseqt {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: INFO os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1d:6f,bridge_name='br-int',has_traffic_filtering=True,id=fcc49a84-024d-42ad-a1fd-562c666a071d,network=Network(014cf20a-a0cd-4676-a16c-05f5ded0bed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc49a84-02')
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:3f:58,bridge_name='br-int',has_traffic_filtering=True,id=0a08866a-ddc0-4637-a4f0-49fddc70fa85,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a08866a-dd') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:3f:58,bridge_name='br-int',has_traffic_filtering=True,id=0a08866a-ddc0-4637-a4f0-49fddc70fa85,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a08866a-dd') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a08866a-dd, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a08866a-dd, col_values=(('external_ids', {'iface-id': '0a08866a-ddc0-4637-a4f0-49fddc70fa85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:3f:58', 'vm-uuid': '52bef016-9676-446b-9a57-a43658e85e3c'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yUuxseqt" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b40ffd-9dde-484d-b303-a56e7f69059a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yUuxseqt'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: INFO os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:3f:58,bridge_name='br-int',has_traffic_filtering=True,id=0a08866a-ddc0-4637-a4f0-49fddc70fa85,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a08866a-dd')
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:96:18,bridge_name='br-int',has_traffic_filtering=True,id=7ee2883e-7b34-4e10-afdf-ef20340172fb,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee2883e-7b') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:96:18,bridge_name='br-int',has_traffic_filtering=True,id=7ee2883e-7b34-4e10-afdf-ef20340172fb,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee2883e-7b') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c4e0b9-32a2-4982-81f7-4fe32995c237]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ee2883e-7b, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ee2883e-7b, col_values=(('external_ids', {'iface-id': '7ee2883e-7b34-4e10-afdf-ef20340172fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:96:18', 'vm-uuid': '52bef016-9676-446b-9a57-a43658e85e3c'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b211ab9-9264-40d9-a394-d263b3a9e2fa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: INFO os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:96:18,bridge_name='br-int',has_traffic_filtering=True,id=7ee2883e-7b34-4e10-afdf-ef20340172fb,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee2883e-7b')
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=e35b56c3-881b-4cc2-bb6f-bab121fbf7a5,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35b56c3-88') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=e35b56c3-881b-4cc2-bb6f-bab121fbf7a5,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35b56c3-88') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape35b56c3-88, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape35b56c3-88, col_values=(('external_ids', {'iface-id': 'e35b56c3-881b-4cc2-bb6f-bab121fbf7a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:97:b1', 'vm-uuid': '52bef016-9676-446b-9a57-a43658e85e3c'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4e9a6d-8b87-4e95-89b9-a5edd64bc298]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554, portal: 172.16.0.220,3260]
Jul 31 12:12:39 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554, portal: 172.16.0.220,3260] successful.
Jul 31 12:12:39 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: INFO os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=e35b56c3-881b-4cc2-bb6f-bab121fbf7a5,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35b56c3-88')
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:83:3a,bridge_name='br-int',has_traffic_filtering=True,id=433edca1-2807-4330-9b81-cadbecb3611a,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap433edca1-28') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:83:3a,bridge_name='br-int',has_traffic_filtering=True,id=433edca1-2807-4330-9b81-cadbecb3611a,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap433edca1-28') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap433edca1-28, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap433edca1-28, col_values=(('external_ids', {'iface-id': '433edca1-2807-4330-9b81-cadbecb3611a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:83:3a', 'vm-uuid': '52bef016-9676-446b-9a57-a43658e85e3c'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01a6db4-02c3-4279-a794-ab966098b0f1]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c0eec0-9940-421f-b661-a5ef00ef762e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:12:39 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: INFO os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:83:3a,bridge_name='br-int',has_traffic_filtering=True,id=433edca1-2807-4330-9b81-cadbecb3611a,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap433edca1-28')
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:cc:65,bridge_name='br-int',has_traffic_filtering=True,id=bb8a12fd-f418-4a88-865b-e7569c051282,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8a12fd-f4') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:cc:65,bridge_name='br-int',has_traffic_filtering=True,id=bb8a12fd-f418-4a88-865b-e7569c051282,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8a12fd-f4') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[461b3863-f4bd-4a6d-8043-383e70526b2e]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUuxseqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb8a12fd-f4, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb8a12fd-f4, col_values=(('external_ids', {'iface-id': 'bb8a12fd-f418-4a88-865b-e7569c051282', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:cc:65', 'vm-uuid': '52bef016-9676-446b-9a57-a43658e85e3c'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: INFO os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:cc:65,bridge_name='br-int',has_traffic_filtering=True,id=bb8a12fd-f418-4a88-865b-e7569c051282,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8a12fd-f4')
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7a:04,bridge_name='br-int',has_traffic_filtering=True,id=16d5f5c4-8b11-4e78-b5ad-048300350e04,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d5f5c4-8b') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7a:04,bridge_name='br-int',has_traffic_filtering=True,id=16d5f5c4-8b11-4e78-b5ad-048300350e04,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d5f5c4-8b') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16d5f5c4-8b, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16d5f5c4-8b, col_values=(('external_ids', {'iface-id': '16d5f5c4-8b11-4e78-b5ad-048300350e04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:7a:04', 'vm-uuid': '52bef016-9676-446b-9a57-a43658e85e3c'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:40 user nova-compute[72447]: INFO os_vif [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7a:04,bridge_name='br-int',has_traffic_filtering=True,id=16d5f5c4-8b11-4e78-b5ad-048300350e04,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d5f5c4-8b')
Jul 31 12:12:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] No BDM found with device name hda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] No VIF found with MAC fa:16:3e:ba:1d:6f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] No VIF found with MAC fa:16:3e:04:83:3a, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:12:40 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Using config drive
Jul 31 12:12:40 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Creating config drive at /opt/stack/data/nova/instances/52bef016-9676-446b-9a57-a43658e85e3c/disk.config
Jul 31 12:12:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/52bef016-9676-446b-9a57-a43658e85e3c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgnkvimyf {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/52bef016-9676-446b-9a57-a43658e85e3c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgnkvimyf" returned: 0 in 0.061s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] <== connect_volume: return (2597ms) {'type': 'block', 'scsi_wwn': '26535663030366338', 'path': '/dev/sde'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535663030366338', 'path': '/dev/sde'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bznVxWsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:40 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:12:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:12:40 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:12:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:12:40 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:12:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f2b013-2dc7-4d68-bb55-6b56fec4dc95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:12:40 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4608db6-5e4b-4518-9c5f-913a996383ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33] added
Jul 31 12:12:40 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4858c189-8a3f-4409-ab8a-186457c097ad]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d757d2-6b33-44b5-89f5-618c7683c1d1]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bznVxWsI {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bznVxWsI" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea28387-659c-461b-9f6b-98b76e46c1d6]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bznVxWsI'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3320045-b7a8-41c3-bcf1-a0bca6dd8732]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cfb458-356b-4ba5-8c28-26de4c084c06]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dae699-65a1-4427-8f0c-fe578917019b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33, portal: 172.16.0.220,3260]
Jul 31 12:12:41 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33, portal: 172.16.0.220,3260] successful.
Jul 31 12:12:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[735af9e7-98f3-421f-9fd1-c0b53e4e2799]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76f9f9e-b669-4f94-8b4e-70f47e801408]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:12:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3c0895-5703-4107-aa7e-81b7ab5a376c]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bznVxWsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-77be9f0d-2455-4074-b45d-5dab5a4e9a3d req-0c10d1c3-292c-4dfb-b664-00cf0dd110d1 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-77be9f0d-2455-4074-b45d-5dab5a4e9a3d req-0c10d1c3-292c-4dfb-b664-00cf0dd110d1 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-77be9f0d-2455-4074-b45d-5dab5a4e9a3d req-0c10d1c3-292c-4dfb-b664-00cf0dd110d1 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-77be9f0d-2455-4074-b45d-5dab5a4e9a3d req-0c10d1c3-292c-4dfb-b664-00cf0dd110d1 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-77be9f0d-2455-4074-b45d-5dab5a4e9a3d req-0c10d1c3-292c-4dfb-b664-00cf0dd110d1 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:42 user nova-compute[72447]: WARNING nova.compute.manager [req-77be9f0d-2455-4074-b45d-5dab5a4e9a3d req-0c10d1c3-292c-4dfb-b664-00cf0dd110d1 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-fcc49a84-024d-42ad-a1fd-562c666a071d for instance with vm_state building and task_state spawning.
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23366396336343638', 'path': '/dev/sdf'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366396336343638', 'path': '/dev/sdf'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usfnFmvA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:42 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:12:42 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:12:42 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b421b76-a69c-48f8-a78a-4e896c619f1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:12:42 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98b3d8e-c2d8-4024-ae8d-850cc3704628]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f] added
Jul 31 12:12:42 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dae933-37c4-4c8f-8a08-d0e9dc55cfd9]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[14902a13-1558-4104-876e-b87fd4c39e3f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usfnFmvA {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usfnFmvA" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b9c46d-d02f-4f16-b46b-59b672544a88]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'usfnFmvA'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb3e276-865c-4e31-bbad-a1e90cb164e7]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fc6cde-4d4a-40eb-b126-50eee993bdc8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcca4694-b19d-43c2-83b5-4e8cb8c8916a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f, portal: 172.16.0.220,3260]
Jul 31 12:12:42 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f, portal: 172.16.0.220,3260] successful.
Jul 31 12:12:42 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba484dd-9ad5-48de-a535-c989f47edc1d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-d8e91420-b147-47e2-b0c5-e4c2e4c1c60e req-04d34c5a-0fa5-45aa-b5a3-269ed24033ee service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-0a08866a-ddc0-4637-a4f0-49fddc70fa85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d8e91420-b147-47e2-b0c5-e4c2e4c1c60e req-04d34c5a-0fa5-45aa-b5a3-269ed24033ee service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d8e91420-b147-47e2-b0c5-e4c2e4c1c60e req-04d34c5a-0fa5-45aa-b5a3-269ed24033ee service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d8e91420-b147-47e2-b0c5-e4c2e4c1c60e req-04d34c5a-0fa5-45aa-b5a3-269ed24033ee service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-d8e91420-b147-47e2-b0c5-e4c2e4c1c60e req-04d34c5a-0fa5-45aa-b5a3-269ed24033ee service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-0a08866a-ddc0-4637-a4f0-49fddc70fa85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:42 user nova-compute[72447]: WARNING nova.compute.manager [req-d8e91420-b147-47e2-b0c5-e4c2e4c1c60e req-04d34c5a-0fa5-45aa-b5a3-269ed24033ee service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-0a08866a-ddc0-4637-a4f0-49fddc70fa85 for instance with vm_state building and task_state spawning.
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e872440f-f9c8-4faf-a9f1-24da4a0f0168]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:12:42 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:12:42 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:12:42 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2063616a-8d84-4490-b371-db78af2becaa]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.compute.manager [req-0c17a534-6b62-4f0e-a733-bcb7b351851d req-a77608dd-3318-4de9-9e84-c78be4d1e094 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0c17a534-6b62-4f0e-a733-bcb7b351851d req-a77608dd-3318-4de9-9e84-c78be4d1e094 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0c17a534-6b62-4f0e-a733-bcb7b351851d req-a77608dd-3318-4de9-9e84-c78be4d1e094 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0c17a534-6b62-4f0e-a733-bcb7b351851d req-a77608dd-3318-4de9-9e84-c78be4d1e094 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.compute.manager [req-0c17a534-6b62-4f0e-a733-bcb7b351851d req-a77608dd-3318-4de9-9e84-c78be4d1e094 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:43 user nova-compute[72447]: WARNING nova.compute.manager [req-0c17a534-6b62-4f0e-a733-bcb7b351851d req-a77608dd-3318-4de9-9e84-c78be4d1e094 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 for instance with vm_state building and task_state spawning.
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usfnFmvA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23265313066633065', 'path': '/dev/sdg'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265313066633065', 'path': '/dev/sdg'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3e:59,bridge_name='br-int',has_traffic_filtering=True,id=756e0675-b763-4145-a0cf-d9f9f9cbe15d,network=Network(85481ea7-4b24-411b-9c56-ec9715dd467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756e0675-b7') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:b3:20,bridge_name='br-int',has_traffic_filtering=True,id=c6f127c0-48e3-47d0-8596-e25666488558,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6f127c0-48') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:12:af,bridge_name='br-int',has_traffic_filtering=True,id=1e5180c3-e48d-4eed-953b-41b1fe9f9d22,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e5180c3-e4') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:24:e5,bridge_name='br-int',has_traffic_filtering=True,id=be660f99-0e0f-4622-8aa4-073606d35a33,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe660f99-0e') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:1e:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f72ad96-4cdb-40f6-b12d-99b8a787709c,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72ad96-4c') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=c2bd8892-ea08-477e-8aff-70be63dfe0e7,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2bd8892-ea') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254eff25-f6ed-48ae-b3e1-4474187862c3", "address": "fa:16:3e:64:d0:a8", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254eff25-f6", "ovs_interfaceid": "254eff25-f6ed-48ae-b3e1-4474187862c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "254eff25-f6ed-48ae-b3e1-4474187862c3", "address": "fa:16:3e:64:d0:a8", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254eff25-f6", "ovs_interfaceid": "254eff25-f6ed-48ae-b3e1-4474187862c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:a8,bridge_name='br-int',has_traffic_filtering=True,id=254eff25-f6ed-48ae-b3e1-4474187862c3,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254eff25-f6') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.objects.instance [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ddee7bd-86de-4bac-84c4-a8813ad9e985 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:12:43 user nova-compute[72447]:   <uuid>8ddee7bd-86de-4bac-84c4-a8813ad9e985</uuid>
Jul 31 12:12:43 user nova-compute[72447]:   <name>instance-0000000c</name>
Jul 31 12:12:43 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:12:43 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:12:43 user nova-compute[72447]:   <metadata>
Jul 31 12:12:43 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:12:43 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:12:43 user nova-compute[72447]:       <nova:name>tempest-device-tagging-server-1544130911</nova:name>
Jul 31 12:12:43 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:12:38</nova:creationTime>
Jul 31 12:12:43 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:12:43 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:12:43 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:12:43 user nova-compute[72447]:       <nova:owner>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:user uuid="b71fe0a0a0a047b9bcdd3f50630b550c">tempest-TaggedBootDevicesTest-1105585884-project-member</nova:user>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:project uuid="88151ca93f3e49c1b60cba124db4eb6d">tempest-TaggedBootDevicesTest-1105585884</nova:project>
Jul 31 12:12:43 user nova-compute[72447]:       </nova:owner>
Jul 31 12:12:43 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:12:43 user nova-compute[72447]:       <nova:ports>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:port uuid="756e0675-b763-4145-a0cf-d9f9f9cbe15d">
Jul 31 12:12:43 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 12:12:43 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:port uuid="c6f127c0-48e3-47d0-8596-e25666488558">
Jul 31 12:12:43 user nova-compute[72447]:           <nova:ip type="fixed" address="10.1.1.19" ipVersion="4"/>
Jul 31 12:12:43 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:port uuid="1e5180c3-e48d-4eed-953b-41b1fe9f9d22">
Jul 31 12:12:43 user nova-compute[72447]:           <nova:ip type="fixed" address="10.1.1.102" ipVersion="4"/>
Jul 31 12:12:43 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:port uuid="be660f99-0e0f-4622-8aa4-073606d35a33">
Jul 31 12:12:43 user nova-compute[72447]:           <nova:ip type="fixed" address="10.1.1.238" ipVersion="4"/>
Jul 31 12:12:43 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:port uuid="2f72ad96-4cdb-40f6-b12d-99b8a787709c">
Jul 31 12:12:43 user nova-compute[72447]:           <nova:ip type="fixed" address="10.1.1.221" ipVersion="4"/>
Jul 31 12:12:43 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:port uuid="c2bd8892-ea08-477e-8aff-70be63dfe0e7">
Jul 31 12:12:43 user nova-compute[72447]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 31 12:12:43 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:43 user nova-compute[72447]:         <nova:port uuid="254eff25-f6ed-48ae-b3e1-4474187862c3">
Jul 31 12:12:43 user nova-compute[72447]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 31 12:12:43 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:43 user nova-compute[72447]:       </nova:ports>
Jul 31 12:12:43 user nova-compute[72447]:     </nova:instance>
Jul 31 12:12:43 user nova-compute[72447]:   </metadata>
Jul 31 12:12:43 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:12:43 user nova-compute[72447]:     <system>
Jul 31 12:12:43 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:12:43 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:12:43 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:12:43 user nova-compute[72447]:       <entry name="serial">8ddee7bd-86de-4bac-84c4-a8813ad9e985</entry>
Jul 31 12:12:43 user nova-compute[72447]:       <entry name="uuid">8ddee7bd-86de-4bac-84c4-a8813ad9e985</entry>
Jul 31 12:12:43 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:12:43 user nova-compute[72447]:     </system>
Jul 31 12:12:43 user nova-compute[72447]:   </sysinfo>
Jul 31 12:12:43 user nova-compute[72447]:   <os>
Jul 31 12:12:43 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:12:43 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:12:43 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:12:43 user nova-compute[72447]:   </os>
Jul 31 12:12:43 user nova-compute[72447]:   <features>
Jul 31 12:12:43 user nova-compute[72447]:     <acpi/>
Jul 31 12:12:43 user nova-compute[72447]:     <apic/>
Jul 31 12:12:43 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:12:43 user nova-compute[72447]:   </features>
Jul 31 12:12:43 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:12:43 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:12:43 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:12:43 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:12:43 user nova-compute[72447]:   </clock>
Jul 31 12:12:43 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:12:43 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:12:43 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:12:43 user nova-compute[72447]:   </cpu>
Jul 31 12:12:43 user nova-compute[72447]:   <devices>
Jul 31 12:12:43 user nova-compute[72447]:     <disk type="file" device="cdrom">
Jul 31 12:12:43 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 12:12:43 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/8ddee7bd-86de-4bac-84c4-a8813ad9e985/disk.config"/>
Jul 31 12:12:43 user nova-compute[72447]:       <target dev="hda" bus="ide"/>
Jul 31 12:12:43 user nova-compute[72447]:     </disk>
Jul 31 12:12:43 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:12:43 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:12:43 user nova-compute[72447]:       <source dev="/dev/sde"/>
Jul 31 12:12:43 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:12:43 user nova-compute[72447]:       <serial>cbd46ce5-571b-4b5d-9f61-f20341cd8554</serial>
Jul 31 12:12:43 user nova-compute[72447]:     </disk>
Jul 31 12:12:43 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:12:43 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:12:43 user nova-compute[72447]:       <source dev="/dev/sdf"/>
Jul 31 12:12:43 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:12:43 user nova-compute[72447]:       <serial>f1614182-a45f-4cf6-85eb-e266aff12e33</serial>
Jul 31 12:12:43 user nova-compute[72447]:     </disk>
Jul 31 12:12:43 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:12:43 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:12:43 user nova-compute[72447]:       <source dev="/dev/sdg"/>
Jul 31 12:12:43 user nova-compute[72447]:       <target dev="vdc" bus="virtio"/>
Jul 31 12:12:43 user nova-compute[72447]:       <serial>e5d76102-adcd-480c-a172-8eb1ea1f170f</serial>
Jul 31 12:12:43 user nova-compute[72447]:     </disk>
Jul 31 12:12:43 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:43 user nova-compute[72447]:       <mac address="fa:16:3e:ea:3e:59"/>
Jul 31 12:12:43 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:43 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:43 user nova-compute[72447]:       <target dev="tap756e0675-b7"/>
Jul 31 12:12:43 user nova-compute[72447]:     </interface>
Jul 31 12:12:43 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:43 user nova-compute[72447]:       <mac address="fa:16:3e:c9:b3:20"/>
Jul 31 12:12:43 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:43 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:43 user nova-compute[72447]:       <target dev="tapc6f127c0-48"/>
Jul 31 12:12:43 user nova-compute[72447]:     </interface>
Jul 31 12:12:43 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:43 user nova-compute[72447]:       <mac address="fa:16:3e:42:12:af"/>
Jul 31 12:12:43 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:43 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:43 user nova-compute[72447]:       <target dev="tap1e5180c3-e4"/>
Jul 31 12:12:43 user nova-compute[72447]:     </interface>
Jul 31 12:12:43 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:43 user nova-compute[72447]:       <mac address="fa:16:3e:99:24:e5"/>
Jul 31 12:12:43 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:43 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:43 user nova-compute[72447]:       <target dev="tapbe660f99-0e"/>
Jul 31 12:12:43 user nova-compute[72447]:     </interface>
Jul 31 12:12:43 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:43 user nova-compute[72447]:       <mac address="fa:16:3e:21:1e:ec"/>
Jul 31 12:12:43 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:43 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:43 user nova-compute[72447]:       <target dev="tap2f72ad96-4c"/>
Jul 31 12:12:43 user nova-compute[72447]:     </interface>
Jul 31 12:12:43 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:43 user nova-compute[72447]:       <mac address="fa:16:3e:be:b1:0c"/>
Jul 31 12:12:43 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:43 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:43 user nova-compute[72447]:       <target dev="tapc2bd8892-ea"/>
Jul 31 12:12:43 user nova-compute[72447]:     </interface>
Jul 31 12:12:43 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:43 user nova-compute[72447]:       <mac address="fa:16:3e:64:d0:a8"/>
Jul 31 12:12:43 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:43 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:43 user nova-compute[72447]:       <target dev="tap254eff25-f6"/>
Jul 31 12:12:43 user nova-compute[72447]:     </interface>
Jul 31 12:12:43 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:12:43 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/8ddee7bd-86de-4bac-84c4-a8813ad9e985/console.log" append="off"/>
Jul 31 12:12:43 user nova-compute[72447]:     </serial>
Jul 31 12:12:43 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:12:43 user nova-compute[72447]:     <video>
Jul 31 12:12:43 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:43 user nova-compute[72447]:     </video>
Jul 31 12:12:43 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:12:43 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:12:43 user nova-compute[72447]:     </rng>
Jul 31 12:12:43 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:12:43 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:12:43 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:12:43 user nova-compute[72447]:     </memballoon>
Jul 31 12:12:43 user nova-compute[72447]:   </devices>
Jul 31 12:12:43 user nova-compute[72447]: </domain>
Jul 31 12:12:43 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3e:59,bridge_name='br-int',has_traffic_filtering=True,id=756e0675-b763-4145-a0cf-d9f9f9cbe15d,network=Network(85481ea7-4b24-411b-9c56-ec9715dd467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756e0675-b7') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3e:59,bridge_name='br-int',has_traffic_filtering=True,id=756e0675-b763-4145-a0cf-d9f9f9cbe15d,network=Network(85481ea7-4b24-411b-9c56-ec9715dd467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756e0675-b7') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap756e0675-b7, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap756e0675-b7, col_values=(('external_ids', {'iface-id': '756e0675-b763-4145-a0cf-d9f9f9cbe15d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:3e:59', 'vm-uuid': '8ddee7bd-86de-4bac-84c4-a8813ad9e985'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: INFO os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3e:59,bridge_name='br-int',has_traffic_filtering=True,id=756e0675-b763-4145-a0cf-d9f9f9cbe15d,network=Network(85481ea7-4b24-411b-9c56-ec9715dd467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756e0675-b7')
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:b3:20,bridge_name='br-int',has_traffic_filtering=True,id=c6f127c0-48e3-47d0-8596-e25666488558,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6f127c0-48') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:b3:20,bridge_name='br-int',has_traffic_filtering=True,id=c6f127c0-48e3-47d0-8596-e25666488558,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6f127c0-48') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6f127c0-48, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6f127c0-48, col_values=(('external_ids', {'iface-id': 'c6f127c0-48e3-47d0-8596-e25666488558', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:b3:20', 'vm-uuid': '8ddee7bd-86de-4bac-84c4-a8813ad9e985'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: INFO os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:b3:20,bridge_name='br-int',has_traffic_filtering=True,id=c6f127c0-48e3-47d0-8596-e25666488558,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6f127c0-48')
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:12:af,bridge_name='br-int',has_traffic_filtering=True,id=1e5180c3-e48d-4eed-953b-41b1fe9f9d22,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e5180c3-e4') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:12:af,bridge_name='br-int',has_traffic_filtering=True,id=1e5180c3-e48d-4eed-953b-41b1fe9f9d22,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e5180c3-e4') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e5180c3-e4, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e5180c3-e4, col_values=(('external_ids', {'iface-id': '1e5180c3-e48d-4eed-953b-41b1fe9f9d22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:12:af', 'vm-uuid': '8ddee7bd-86de-4bac-84c4-a8813ad9e985'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: INFO os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:12:af,bridge_name='br-int',has_traffic_filtering=True,id=1e5180c3-e48d-4eed-953b-41b1fe9f9d22,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e5180c3-e4')
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:24:e5,bridge_name='br-int',has_traffic_filtering=True,id=be660f99-0e0f-4622-8aa4-073606d35a33,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe660f99-0e') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:24:e5,bridge_name='br-int',has_traffic_filtering=True,id=be660f99-0e0f-4622-8aa4-073606d35a33,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe660f99-0e') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe660f99-0e, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe660f99-0e, col_values=(('external_ids', {'iface-id': 'be660f99-0e0f-4622-8aa4-073606d35a33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:24:e5', 'vm-uuid': '8ddee7bd-86de-4bac-84c4-a8813ad9e985'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: INFO os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:24:e5,bridge_name='br-int',has_traffic_filtering=True,id=be660f99-0e0f-4622-8aa4-073606d35a33,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe660f99-0e')
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:1e:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f72ad96-4cdb-40f6-b12d-99b8a787709c,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72ad96-4c') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:1e:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f72ad96-4cdb-40f6-b12d-99b8a787709c,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72ad96-4c') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f72ad96-4c, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f72ad96-4c, col_values=(('external_ids', {'iface-id': '2f72ad96-4cdb-40f6-b12d-99b8a787709c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:1e:ec', 'vm-uuid': '8ddee7bd-86de-4bac-84c4-a8813ad9e985'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: INFO os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:1e:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f72ad96-4cdb-40f6-b12d-99b8a787709c,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72ad96-4c')
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=c2bd8892-ea08-477e-8aff-70be63dfe0e7,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2bd8892-ea') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=c2bd8892-ea08-477e-8aff-70be63dfe0e7,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2bd8892-ea') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2bd8892-ea, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2bd8892-ea, col_values=(('external_ids', {'iface-id': 'c2bd8892-ea08-477e-8aff-70be63dfe0e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:b1:0c', 'vm-uuid': '8ddee7bd-86de-4bac-84c4-a8813ad9e985'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-b54d9486-519c-4758-992e-f13ac1fd2c2c req-4645c7e7-b061-4d04-a5c4-b327228909cf service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b54d9486-519c-4758-992e-f13ac1fd2c2c req-4645c7e7-b061-4d04-a5c4-b327228909cf service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b54d9486-519c-4758-992e-f13ac1fd2c2c req-4645c7e7-b061-4d04-a5c4-b327228909cf service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b54d9486-519c-4758-992e-f13ac1fd2c2c req-4645c7e7-b061-4d04-a5c4-b327228909cf service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-b54d9486-519c-4758-992e-f13ac1fd2c2c req-4645c7e7-b061-4d04-a5c4-b327228909cf service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:44 user nova-compute[72447]: WARNING nova.compute.manager [req-b54d9486-519c-4758-992e-f13ac1fd2c2c req-4645c7e7-b061-4d04-a5c4-b327228909cf service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-fcc49a84-024d-42ad-a1fd-562c666a071d for instance with vm_state building and task_state spawning.
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-b54d9486-519c-4758-992e-f13ac1fd2c2c req-4645c7e7-b061-4d04-a5c4-b327228909cf service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b54d9486-519c-4758-992e-f13ac1fd2c2c req-4645c7e7-b061-4d04-a5c4-b327228909cf service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b54d9486-519c-4758-992e-f13ac1fd2c2c req-4645c7e7-b061-4d04-a5c4-b327228909cf service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b54d9486-519c-4758-992e-f13ac1fd2c2c req-4645c7e7-b061-4d04-a5c4-b327228909cf service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-b54d9486-519c-4758-992e-f13ac1fd2c2c req-4645c7e7-b061-4d04-a5c4-b327228909cf service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:44 user nova-compute[72447]: WARNING nova.compute.manager [req-b54d9486-519c-4758-992e-f13ac1fd2c2c req-4645c7e7-b061-4d04-a5c4-b327228909cf service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-bb8a12fd-f418-4a88-865b-e7569c051282 for instance with vm_state building and task_state spawning.
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: INFO os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=c2bd8892-ea08-477e-8aff-70be63dfe0e7,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2bd8892-ea')
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254eff25-f6ed-48ae-b3e1-4474187862c3", "address": "fa:16:3e:64:d0:a8", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254eff25-f6", "ovs_interfaceid": "254eff25-f6ed-48ae-b3e1-4474187862c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "254eff25-f6ed-48ae-b3e1-4474187862c3", "address": "fa:16:3e:64:d0:a8", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254eff25-f6", "ovs_interfaceid": "254eff25-f6ed-48ae-b3e1-4474187862c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:a8,bridge_name='br-int',has_traffic_filtering=True,id=254eff25-f6ed-48ae-b3e1-4474187862c3,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254eff25-f6') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:a8,bridge_name='br-int',has_traffic_filtering=True,id=254eff25-f6ed-48ae-b3e1-4474187862c3,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254eff25-f6') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap254eff25-f6, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap254eff25-f6, col_values=(('external_ids', {'iface-id': '254eff25-f6ed-48ae-b3e1-4474187862c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:d0:a8', 'vm-uuid': '8ddee7bd-86de-4bac-84c4-a8813ad9e985'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: INFO os_vif [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:a8,bridge_name='br-int',has_traffic_filtering=True,id=254eff25-f6ed-48ae-b3e1-4474187862c3,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254eff25-f6')
Jul 31 12:12:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Updating instance_info_cache with network_info: [{"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-0a08866a-ddc0-4637-a4f0-49fddc70fa85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-0a08866a-ddc0-4637-a4f0-49fddc70fa85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:44 user nova-compute[72447]: WARNING nova.compute.manager [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-0a08866a-ddc0-4637-a4f0-49fddc70fa85 for instance with vm_state building and task_state spawning.
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-7ee2883e-7b34-4e10-afdf-ef20340172fb {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-7ee2883e-7b34-4e10-afdf-ef20340172fb {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:44 user nova-compute[72447]: WARNING nova.compute.manager [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-7ee2883e-7b34-4e10-afdf-ef20340172fb for instance with vm_state building and task_state spawning.
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-7ee2883e-7b34-4e10-afdf-ef20340172fb {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-7ee2883e-7b34-4e10-afdf-ef20340172fb {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:44 user nova-compute[72447]: WARNING nova.compute.manager [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-7ee2883e-7b34-4e10-afdf-ef20340172fb for instance with vm_state building and task_state spawning.
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:44 user nova-compute[72447]: WARNING nova.compute.manager [req-37ce0f99-6d4c-4765-a9f0-e7cffaa98243 req-0f3db0c2-6bef-4787-b330-e266b194ed7a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-433edca1-2807-4330-9b81-cadbecb3611a for instance with vm_state building and task_state spawning.
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] No BDM found with device name hda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] No VIF found with MAC fa:16:3e:ea:3e:59, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] No VIF found with MAC fa:16:3e:21:1e:ec, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:12:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Using config drive
Jul 31 12:12:44 user nova-compute[72447]: INFO nova.compute.manager [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Rescuing
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquired lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:44 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:12:45 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Creating config drive at /opt/stack/data/nova/instances/8ddee7bd-86de-4bac-84c4-a8813ad9e985/disk.config
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8ddee7bd-86de-4bac-84c4-a8813ad9e985/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpak8pmi46 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8ddee7bd-86de-4bac-84c4-a8813ad9e985/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpak8pmi46" returned: 0 in 0.055s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-9ce266b8-b1cb-4cb0-bb77-0f23a04a25b6 req-815740ff-96d0-4754-ac3d-dca6d9c2a316 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9ce266b8-b1cb-4cb0-bb77-0f23a04a25b6 req-815740ff-96d0-4754-ac3d-dca6d9c2a316 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9ce266b8-b1cb-4cb0-bb77-0f23a04a25b6 req-815740ff-96d0-4754-ac3d-dca6d9c2a316 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9ce266b8-b1cb-4cb0-bb77-0f23a04a25b6 req-815740ff-96d0-4754-ac3d-dca6d9c2a316 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-9ce266b8-b1cb-4cb0-bb77-0f23a04a25b6 req-815740ff-96d0-4754-ac3d-dca6d9c2a316 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:45 user nova-compute[72447]: WARNING nova.compute.manager [req-9ce266b8-b1cb-4cb0-bb77-0f23a04a25b6 req-815740ff-96d0-4754-ac3d-dca6d9c2a316 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 for instance with vm_state building and task_state spawning.
Jul 31 12:12:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Updating instance_info_cache with network_info: [{"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Releasing lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-43a276ef-0cf1-4a43-92d3-f8feece23b8e req-083506a6-086a-4a69-a742-a508426c3a72 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-43a276ef-0cf1-4a43-92d3-f8feece23b8e req-083506a6-086a-4a69-a742-a508426c3a72 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-43a276ef-0cf1-4a43-92d3-f8feece23b8e req-083506a6-086a-4a69-a742-a508426c3a72 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-43a276ef-0cf1-4a43-92d3-f8feece23b8e req-083506a6-086a-4a69-a742-a508426c3a72 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-43a276ef-0cf1-4a43-92d3-f8feece23b8e req-083506a6-086a-4a69-a742-a508426c3a72 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:46 user nova-compute[72447]: WARNING nova.compute.manager [req-43a276ef-0cf1-4a43-92d3-f8feece23b8e req-083506a6-086a-4a69-a742-a508426c3a72 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-bb8a12fd-f418-4a88-865b-e7569c051282 for instance with vm_state building and task_state spawning.
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805566.3557067, 52bef016-9676-446b-9a57-a43658e85e3c => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:12:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] VM Resumed (Lifecycle Event)
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:12:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Instance spawned successfully.
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:12:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805566.3584466, 52bef016-9676-446b-9a57-a43658e85e3c => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:12:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] VM Started (Lifecycle Event)
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:12:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:46 user nova-compute[72447]: INFO nova.compute.manager [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Took 11.12 seconds to spawn the instance on the hypervisor.
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:12:46 user nova-compute[72447]: INFO nova.compute.manager [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Took 39.17 seconds to build instance.
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bf5cd62a-2f7d-49c1-a9f4-62af4134c539 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "52bef016-9676-446b-9a57-a43658e85e3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.313s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:46 user nova-compute[72447]: WARNING nova.compute.manager [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-433edca1-2807-4330-9b81-cadbecb3611a for instance with vm_state active and task_state None.
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:46 user nova-compute[72447]: WARNING nova.compute.manager [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-16d5f5c4-8b11-4e78-b5ad-048300350e04 for instance with vm_state active and task_state None.
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:46 user nova-compute[72447]: WARNING nova.compute.manager [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-16d5f5c4-8b11-4e78-b5ad-048300350e04 for instance with vm_state active and task_state None.
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received event network-vif-unplugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] Acquiring lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] No waiting events found dispatching network-vif-unplugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:46 user nova-compute[72447]: WARNING nova.compute.manager [req-73076e79-b8c6-47df-a4d1-977fb9d0f69a req-fbf78cc3-18f8-45c6-b217-9373ac85eb73 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received unexpected event network-vif-unplugged-8e631d77-6caf-4106-8a95-8f90c2e6417d for instance with vm_state active and task_state rescuing.
Jul 31 12:12:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-b688ef3b-9e89-49b8-9e0d-11c03bbd1668 req-78e97540-e545-4832-81ea-136f05c63f10 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b688ef3b-9e89-49b8-9e0d-11c03bbd1668 req-78e97540-e545-4832-81ea-136f05c63f10 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b688ef3b-9e89-49b8-9e0d-11c03bbd1668 req-78e97540-e545-4832-81ea-136f05c63f10 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b688ef3b-9e89-49b8-9e0d-11c03bbd1668 req-78e97540-e545-4832-81ea-136f05c63f10 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-b688ef3b-9e89-49b8-9e0d-11c03bbd1668 req-78e97540-e545-4832-81ea-136f05c63f10 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:47 user nova-compute[72447]: WARNING nova.compute.manager [req-b688ef3b-9e89-49b8-9e0d-11c03bbd1668 req-78e97540-e545-4832-81ea-136f05c63f10 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-756e0675-b763-4145-a0cf-d9f9f9cbe15d for instance with vm_state building and task_state spawning.
Jul 31 12:12:47 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Instance destroyed successfully.
Jul 31 12:12:47 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Attempting rescue
Jul 31 12:12:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72447) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Instance directory exists: not creating {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 12:12:47 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Creating image(s)
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "/opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "/opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "/opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00c9825b-0cc3-4c07-87bf-bffaabe4c265 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.194s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue" returned: 0 in 0.063s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'migration_context' on Instance uuid 00c9825b-0cc3-4c07-87bf-bffaabe4c265 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Start _get_guest_xml network_info=[{"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "vif_mac": "fa:16:3e:8f:e3:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'resources' on Instance uuid 00c9825b-0cc3-4c07-87bf-bffaabe4c265 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'numa_topology' on Instance uuid 00c9825b-0cc3-4c07-87bf-bffaabe4c265 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:48 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:12:48 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00c9825b-0cc3-4c07-87bf-bffaabe4c265 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-126637251',display_name='tempest-ServerRescueNegativeTestJSON-server-126637251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-126637251',id=2,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9576e1abb5b1475da061ca824d7c3788',ramdisk_id='',reservation_id='r-upw6bz0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2103641702',owner_user_name='tempest-ServerRescueNegativeTestJSON-2103641702-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:08Z,user_data=None,user_id='cbcdd571b45b4450a8b27b834a05a2b6',uuid=00c9825b-0cc3-4c07-87bf-bffaabe4c265,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "vif_mac": "fa:16:3e:8f:e3:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converting VIF {"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "vif_mac": "fa:16:3e:8f:e3:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:e3:9f,bridge_name='br-int',has_traffic_filtering=True,id=8e631d77-6caf-4106-8a95-8f90c2e6417d,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e631d77-6c') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'pci_devices' on Instance uuid 00c9825b-0cc3-4c07-87bf-bffaabe4c265 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:12:48 user nova-compute[72447]:   <uuid>00c9825b-0cc3-4c07-87bf-bffaabe4c265</uuid>
Jul 31 12:12:48 user nova-compute[72447]:   <name>instance-00000002</name>
Jul 31 12:12:48 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:12:48 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:12:48 user nova-compute[72447]:   <metadata>
Jul 31 12:12:48 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:12:48 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:12:48 user nova-compute[72447]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-126637251</nova:name>
Jul 31 12:12:48 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:12:48</nova:creationTime>
Jul 31 12:12:48 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:12:48 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:12:48 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:12:48 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:12:48 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:12:48 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:12:48 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:12:48 user nova-compute[72447]:       <nova:owner>
Jul 31 12:12:48 user nova-compute[72447]:         <nova:user uuid="cbcdd571b45b4450a8b27b834a05a2b6">tempest-ServerRescueNegativeTestJSON-2103641702-project-member</nova:user>
Jul 31 12:12:48 user nova-compute[72447]:         <nova:project uuid="9576e1abb5b1475da061ca824d7c3788">tempest-ServerRescueNegativeTestJSON-2103641702</nova:project>
Jul 31 12:12:48 user nova-compute[72447]:       </nova:owner>
Jul 31 12:12:48 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:12:48 user nova-compute[72447]:       <nova:ports>
Jul 31 12:12:48 user nova-compute[72447]:         <nova:port uuid="8e631d77-6caf-4106-8a95-8f90c2e6417d">
Jul 31 12:12:48 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 12:12:48 user nova-compute[72447]:         </nova:port>
Jul 31 12:12:48 user nova-compute[72447]:       </nova:ports>
Jul 31 12:12:48 user nova-compute[72447]:     </nova:instance>
Jul 31 12:12:48 user nova-compute[72447]:   </metadata>
Jul 31 12:12:48 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:12:48 user nova-compute[72447]:     <system>
Jul 31 12:12:48 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:12:48 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:12:48 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:12:48 user nova-compute[72447]:       <entry name="serial">00c9825b-0cc3-4c07-87bf-bffaabe4c265</entry>
Jul 31 12:12:48 user nova-compute[72447]:       <entry name="uuid">00c9825b-0cc3-4c07-87bf-bffaabe4c265</entry>
Jul 31 12:12:48 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:12:48 user nova-compute[72447]:     </system>
Jul 31 12:12:48 user nova-compute[72447]:   </sysinfo>
Jul 31 12:12:48 user nova-compute[72447]:   <os>
Jul 31 12:12:48 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:12:48 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:12:48 user nova-compute[72447]:   </os>
Jul 31 12:12:48 user nova-compute[72447]:   <features>
Jul 31 12:12:48 user nova-compute[72447]:     <acpi/>
Jul 31 12:12:48 user nova-compute[72447]:     <apic/>
Jul 31 12:12:48 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:12:48 user nova-compute[72447]:   </features>
Jul 31 12:12:48 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:12:48 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:12:48 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:12:48 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:12:48 user nova-compute[72447]:   </clock>
Jul 31 12:12:48 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:12:48 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:12:48 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:12:48 user nova-compute[72447]:   </cpu>
Jul 31 12:12:48 user nova-compute[72447]:   <devices>
Jul 31 12:12:48 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:12:48 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:12:48 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue"/>
Jul 31 12:12:48 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:12:48 user nova-compute[72447]:     </disk>
Jul 31 12:12:48 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:12:48 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:12:48 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk"/>
Jul 31 12:12:48 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:12:48 user nova-compute[72447]:     </disk>
Jul 31 12:12:48 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:12:48 user nova-compute[72447]:       <mac address="fa:16:3e:8f:e3:9f"/>
Jul 31 12:12:48 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:48 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:12:48 user nova-compute[72447]:       <target dev="tap8e631d77-6c"/>
Jul 31 12:12:48 user nova-compute[72447]:     </interface>
Jul 31 12:12:48 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:12:48 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/console.log" append="off"/>
Jul 31 12:12:48 user nova-compute[72447]:     </serial>
Jul 31 12:12:48 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:12:48 user nova-compute[72447]:     <video>
Jul 31 12:12:48 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:12:48 user nova-compute[72447]:     </video>
Jul 31 12:12:48 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:12:48 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:12:48 user nova-compute[72447]:     </rng>
Jul 31 12:12:48 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:12:48 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:12:48 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:12:48 user nova-compute[72447]:     </memballoon>
Jul 31 12:12:48 user nova-compute[72447]:   </devices>
Jul 31 12:12:48 user nova-compute[72447]: </domain>
Jul 31 12:12:48 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:12:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Instance destroyed successfully.
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No VIF found with MAC fa:16:3e:8f:e3:9f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-8543b504-1475-46aa-ae54-540a4492ecc0 req-510e96f3-3a15-4ae0-9022-74e6739b925a service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8543b504-1475-46aa-ae54-540a4492ecc0 req-510e96f3-3a15-4ae0-9022-74e6739b925a service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8543b504-1475-46aa-ae54-540a4492ecc0 req-510e96f3-3a15-4ae0-9022-74e6739b925a service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8543b504-1475-46aa-ae54-540a4492ecc0 req-510e96f3-3a15-4ae0-9022-74e6739b925a service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-8543b504-1475-46aa-ae54-540a4492ecc0 req-510e96f3-3a15-4ae0-9022-74e6739b925a service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:48 user nova-compute[72447]: WARNING nova.compute.manager [req-8543b504-1475-46aa-ae54-540a4492ecc0 req-510e96f3-3a15-4ae0-9022-74e6739b925a service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-be660f99-0e0f-4622-8aa4-073606d35a33 for instance with vm_state building and task_state spawning.
Jul 31 12:12:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-9502eca7-53fc-4541-ae27-76cca65b82c2 req-07a6fea2-4e39-4794-bf05-c273ec5ca18a service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received event network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9502eca7-53fc-4541-ae27-76cca65b82c2 req-07a6fea2-4e39-4794-bf05-c273ec5ca18a service nova] Acquiring lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9502eca7-53fc-4541-ae27-76cca65b82c2 req-07a6fea2-4e39-4794-bf05-c273ec5ca18a service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9502eca7-53fc-4541-ae27-76cca65b82c2 req-07a6fea2-4e39-4794-bf05-c273ec5ca18a service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-9502eca7-53fc-4541-ae27-76cca65b82c2 req-07a6fea2-4e39-4794-bf05-c273ec5ca18a service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] No waiting events found dispatching network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:48 user nova-compute[72447]: WARNING nova.compute.manager [req-9502eca7-53fc-4541-ae27-76cca65b82c2 req-07a6fea2-4e39-4794-bf05-c273ec5ca18a service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received unexpected event network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d for instance with vm_state active and task_state rescuing.
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-9502eca7-53fc-4541-ae27-76cca65b82c2 req-07a6fea2-4e39-4794-bf05-c273ec5ca18a service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9502eca7-53fc-4541-ae27-76cca65b82c2 req-07a6fea2-4e39-4794-bf05-c273ec5ca18a service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9502eca7-53fc-4541-ae27-76cca65b82c2 req-07a6fea2-4e39-4794-bf05-c273ec5ca18a service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9502eca7-53fc-4541-ae27-76cca65b82c2 req-07a6fea2-4e39-4794-bf05-c273ec5ca18a service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-9502eca7-53fc-4541-ae27-76cca65b82c2 req-07a6fea2-4e39-4794-bf05-c273ec5ca18a service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:48 user nova-compute[72447]: WARNING nova.compute.manager [req-9502eca7-53fc-4541-ae27-76cca65b82c2 req-07a6fea2-4e39-4794-bf05-c273ec5ca18a service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 for instance with vm_state building and task_state spawning.
Jul 31 12:12:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:49 user nova-compute[72447]: WARNING nova.compute.manager [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-756e0675-b763-4145-a0cf-d9f9f9cbe15d for instance with vm_state building and task_state spawning.
Jul 31 12:12:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-c6f127c0-48e3-47d0-8596-e25666488558 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-c6f127c0-48e3-47d0-8596-e25666488558 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:49 user nova-compute[72447]: WARNING nova.compute.manager [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-c6f127c0-48e3-47d0-8596-e25666488558 for instance with vm_state building and task_state spawning.
Jul 31 12:12:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-c6f127c0-48e3-47d0-8596-e25666488558 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-c6f127c0-48e3-47d0-8596-e25666488558 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:49 user nova-compute[72447]: WARNING nova.compute.manager [req-7e0425b4-e1a2-4d9e-9dcb-aa4cf36b78df req-94c50150-1ad3-45a7-8367-34dc716e9e56 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-c6f127c0-48e3-47d0-8596-e25666488558 for instance with vm_state building and task_state spawning.
Jul 31 12:12:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:50 user nova-compute[72447]: WARNING nova.compute.manager [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-be660f99-0e0f-4622-8aa4-073606d35a33 for instance with vm_state building and task_state spawning.
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:50 user nova-compute[72447]: WARNING nova.compute.manager [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-c2bd8892-ea08-477e-8aff-70be63dfe0e7 for instance with vm_state building and task_state spawning.
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:50 user nova-compute[72447]: WARNING nova.compute.manager [req-998929c1-a389-4191-ba5d-0c67e1d49dbd req-554d273f-011a-4859-8f37-39fc29ba4e22 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-c2bd8892-ea08-477e-8aff-70be63dfe0e7 for instance with vm_state building and task_state spawning.
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:50 user nova-compute[72447]: WARNING nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 for instance with vm_state building and task_state spawning.
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:50 user nova-compute[72447]: WARNING nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-2f72ad96-4cdb-40f6-b12d-99b8a787709c for instance with vm_state building and task_state spawning.
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:50 user nova-compute[72447]: WARNING nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-2f72ad96-4cdb-40f6-b12d-99b8a787709c for instance with vm_state building and task_state spawning.
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:50 user nova-compute[72447]: WARNING nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-254eff25-f6ed-48ae-b3e1-4474187862c3 for instance with vm_state building and task_state spawning.
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:50 user nova-compute[72447]: WARNING nova.compute.manager [req-af3d33b6-5f87-42f4-a352-596b13170d75 req-508b6bd6-c6c6-4cd8-b8eb-644dad9f0576 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-254eff25-f6ed-48ae-b3e1-4474187862c3 for instance with vm_state building and task_state spawning.
Jul 31 12:12:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-99c7e71c-0a24-4dd1-9e53-9201d93d890e req-b9c99eed-6501-481a-80a8-65bfc85d4ec8 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-changed-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-99c7e71c-0a24-4dd1-9e53-9201d93d890e req-b9c99eed-6501-481a-80a8-65bfc85d4ec8 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Refreshing instance network info cache due to event network-changed-f276935a-5cfd-4a23-a87e-cbab33adf21e. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-99c7e71c-0a24-4dd1-9e53-9201d93d890e req-b9c99eed-6501-481a-80a8-65bfc85d4ec8 service nova] Acquiring lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-99c7e71c-0a24-4dd1-9e53-9201d93d890e req-b9c99eed-6501-481a-80a8-65bfc85d4ec8 service nova] Acquired lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG nova.network.neutron [req-99c7e71c-0a24-4dd1-9e53-9201d93d890e req-b9c99eed-6501-481a-80a8-65bfc85d4ec8 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Refreshing network info cache for port f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:12:52 user nova-compute[72447]: DEBUG nova.network.neutron [req-99c7e71c-0a24-4dd1-9e53-9201d93d890e req-b9c99eed-6501-481a-80a8-65bfc85d4ec8 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updated VIF entry in instance network info cache for port f276935a-5cfd-4a23-a87e-cbab33adf21e. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:12:52 user nova-compute[72447]: DEBUG nova.network.neutron [req-99c7e71c-0a24-4dd1-9e53-9201d93d890e req-b9c99eed-6501-481a-80a8-65bfc85d4ec8 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updating instance_info_cache with network_info: [{"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-99c7e71c-0a24-4dd1-9e53-9201d93d890e req-b9c99eed-6501-481a-80a8-65bfc85d4ec8 service nova] Releasing lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:52 user nova-compute[72447]: INFO nova.compute.manager [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] instance snapshotting
Jul 31 12:12:52 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Beginning live snapshot process
Jul 31 12:12:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-709a24d2-34ae-4b8d-a3cb-35c80f981b89 req-917abfdb-690d-409d-b058-6b9f60ffd555 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-changed-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-709a24d2-34ae-4b8d-a3cb-35c80f981b89 req-917abfdb-690d-409d-b058-6b9f60ffd555 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Refreshing instance network info cache due to event network-changed-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-709a24d2-34ae-4b8d-a3cb-35c80f981b89 req-917abfdb-690d-409d-b058-6b9f60ffd555 service nova] Acquiring lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-709a24d2-34ae-4b8d-a3cb-35c80f981b89 req-917abfdb-690d-409d-b058-6b9f60ffd555 service nova] Acquired lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:52 user nova-compute[72447]: DEBUG nova.network.neutron [req-709a24d2-34ae-4b8d-a3cb-35c80f981b89 req-917abfdb-690d-409d-b058-6b9f60ffd555 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Refreshing network info cache for port c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.compute.manager [req-a5ea886f-0f26-469f-8fc5-cceae9212083 req-86e9ba4e-0712-4645-b35d-edc99e21a41a service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received event network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a5ea886f-0f26-469f-8fc5-cceae9212083 req-86e9ba4e-0712-4645-b35d-edc99e21a41a service nova] Acquiring lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a5ea886f-0f26-469f-8fc5-cceae9212083 req-86e9ba4e-0712-4645-b35d-edc99e21a41a service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a5ea886f-0f26-469f-8fc5-cceae9212083 req-86e9ba4e-0712-4645-b35d-edc99e21a41a service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.compute.manager [req-a5ea886f-0f26-469f-8fc5-cceae9212083 req-86e9ba4e-0712-4645-b35d-edc99e21a41a service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] No waiting events found dispatching network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:53 user nova-compute[72447]: WARNING nova.compute.manager [req-a5ea886f-0f26-469f-8fc5-cceae9212083 req-86e9ba4e-0712-4645-b35d-edc99e21a41a service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received unexpected event network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d for instance with vm_state active and task_state rescuing.
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.compute.manager [req-a5ea886f-0f26-469f-8fc5-cceae9212083 req-86e9ba4e-0712-4645-b35d-edc99e21a41a service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received event network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a5ea886f-0f26-469f-8fc5-cceae9212083 req-86e9ba4e-0712-4645-b35d-edc99e21a41a service nova] Acquiring lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a5ea886f-0f26-469f-8fc5-cceae9212083 req-86e9ba4e-0712-4645-b35d-edc99e21a41a service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a5ea886f-0f26-469f-8fc5-cceae9212083 req-86e9ba4e-0712-4645-b35d-edc99e21a41a service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.compute.manager [req-a5ea886f-0f26-469f-8fc5-cceae9212083 req-86e9ba4e-0712-4645-b35d-edc99e21a41a service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] No waiting events found dispatching network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:53 user nova-compute[72447]: WARNING nova.compute.manager [req-a5ea886f-0f26-469f-8fc5-cceae9212083 req-86e9ba4e-0712-4645-b35d-edc99e21a41a service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received unexpected event network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d for instance with vm_state active and task_state rescuing.
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json -f qcow2 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json -f qcow2 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.165s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpm3tebm7y/9e1701cf155a400bab9b4d04bb665a76.delta 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpm3tebm7y/9e1701cf155a400bab9b4d04bb665a76.delta 1073741824" returned: 0 in 0.055s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:53 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72447) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 31 12:12:53 user nova-compute[72447]: INFO nova.virt.libvirt.host [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] UEFI support detected
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805573.8522131, 8ddee7bd-86de-4bac-84c4-a8813ad9e985 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:12:53 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] VM Resumed (Lifecycle Event)
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:53 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Instance spawned successfully.
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.network.neutron [req-709a24d2-34ae-4b8d-a3cb-35c80f981b89 req-917abfdb-690d-409d-b058-6b9f60ffd555 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updated VIF entry in instance network info cache for port c9c41aee-bb54-4d97-8f69-9dd65e2c97b7. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.network.neutron [req-709a24d2-34ae-4b8d-a3cb-35c80f981b89 req-917abfdb-690d-409d-b058-6b9f60ffd555 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updating instance_info_cache with network_info: [{"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:12:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-709a24d2-34ae-4b8d-a3cb-35c80f981b89 req-917abfdb-690d-409d-b058-6b9f60ffd555 service nova] Releasing lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:54 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805573.860825, 8ddee7bd-86de-4bac-84c4-a8813ad9e985 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:12:54 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] VM Started (Lifecycle Event)
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-e7eaac90-63da-408c-b33e-e2a0a7982966 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:12:54 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:12:54 user nova-compute[72447]: INFO nova.compute.manager [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Took 15.93 seconds to spawn the instance on the hypervisor.
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 00c9825b-0cc3-4c07-87bf-bffaabe4c265 due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805574.0668793, 00c9825b-0cc3-4c07-87bf-bffaabe4c265 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:12:54 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] VM Resumed (Lifecycle Event)
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:12:54 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805574.0828707, 00c9825b-0cc3-4c07-87bf-bffaabe4c265 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:12:54 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] VM Started (Lifecycle Event)
Jul 31 12:12:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:12:54 user nova-compute[72447]: INFO nova.compute.manager [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Took 42.04 seconds to build instance.
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-082caf8d-704e-40b2-a84f-6bf86a2b93bc tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.211s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG nova.compute.manager [req-a8cee305-05ee-4247-be08-2685988f7f43 req-d26b1fe2-1ec4-4200-8674-8402b8dabb84 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Received event network-changed-9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG nova.compute.manager [req-a8cee305-05ee-4247-be08-2685988f7f43 req-d26b1fe2-1ec4-4200-8674-8402b8dabb84 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Refreshing instance network info cache due to event network-changed-9bc7922e-33db-4822-a9b9-497abe3fb078. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a8cee305-05ee-4247-be08-2685988f7f43 req-d26b1fe2-1ec4-4200-8674-8402b8dabb84 service nova] Acquiring lock "refresh_cache-ba0c6dba-0035-4196-a05f-9335436fac86" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a8cee305-05ee-4247-be08-2685988f7f43 req-d26b1fe2-1ec4-4200-8674-8402b8dabb84 service nova] Acquired lock "refresh_cache-ba0c6dba-0035-4196-a05f-9335436fac86" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG nova.network.neutron [req-a8cee305-05ee-4247-be08-2685988f7f43 req-d26b1fe2-1ec4-4200-8674-8402b8dabb84 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Refreshing network info cache for port 9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:55 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 12:12:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpm3tebm7y/9e1701cf155a400bab9b4d04bb665a76.delta /opt/stack/data/nova/instances/snapshots/tmpm3tebm7y/9e1701cf155a400bab9b4d04bb665a76 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpm3tebm7y/9e1701cf155a400bab9b4d04bb665a76.delta /opt/stack/data/nova/instances/snapshots/tmpm3tebm7y/9e1701cf155a400bab9b4d04bb665a76" returned: 0 in 0.691s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:56 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Snapshot extracted, beginning image upload
Jul 31 12:12:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:56 user nova-compute[72447]: DEBUG nova.network.neutron [req-a8cee305-05ee-4247-be08-2685988f7f43 req-d26b1fe2-1ec4-4200-8674-8402b8dabb84 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Updated VIF entry in instance network info cache for port 9bc7922e-33db-4822-a9b9-497abe3fb078. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:12:56 user nova-compute[72447]: DEBUG nova.network.neutron [req-a8cee305-05ee-4247-be08-2685988f7f43 req-d26b1fe2-1ec4-4200-8674-8402b8dabb84 service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Updating instance_info_cache with network_info: [{"id": "9bc7922e-33db-4822-a9b9-497abe3fb078", "address": "fa:16:3e:62:fc:84", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc7922e-33", "ovs_interfaceid": "9bc7922e-33db-4822-a9b9-497abe3fb078", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:12:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a8cee305-05ee-4247-be08-2685988f7f43 req-d26b1fe2-1ec4-4200-8674-8402b8dabb84 service nova] Releasing lock "refresh_cache-ba0c6dba-0035-4196-a05f-9335436fac86" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:12:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:12:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:12:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:12:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "ba0c6dba-0035-4196-a05f-9335436fac86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "ba0c6dba-0035-4196-a05f-9335436fac86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "6c701045-e520-421f-94d2-b54edd0d5c54" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:58 user nova-compute[72447]: INFO nova.compute.manager [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Shelving
Jul 31 12:12:58 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'flavor' on Instance uuid ba0c6dba-0035-4196-a05f-9335436fac86 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:12:58 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:12:58 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:12:58 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=6806MB free_disk=25.569080352783203GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:12:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "ba0c6dba-0035-4196-a05f-9335436fac86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.198s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6c701045-e520-421f-94d2-b54edd0d5c54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance ba0c6dba-0035-4196-a05f-9335436fac86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 700d80d6-9248-4d6f-9010-c3904d8fec2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b2cab306-7667-47cf-a689-75ad6d6b5dc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 5b461cf8-5cb4-4dff-9bba-20930ec4ee84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 52bef016-9676-446b-9a57-a43658e85e3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 8ddee7bd-86de-4bac-84c4-a8813ad9e985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "ba0c6dba-0035-4196-a05f-9335436fac86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "ba0c6dba-0035-4196-a05f-9335436fac86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:59 user nova-compute[72447]: INFO nova.compute.manager [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Attaching volume 35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 to /dev/vdb
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-0721bf9e-9e29-4d5f-b0f3-86ea9f23758d req-493c9368-8dbc-4122-b885-877fa77d9d77 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-vif-unplugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0721bf9e-9e29-4d5f-b0f3-86ea9f23758d req-493c9368-8dbc-4122-b885-877fa77d9d77 service nova] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0721bf9e-9e29-4d5f-b0f3-86ea9f23758d req-493c9368-8dbc-4122-b885-877fa77d9d77 service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0721bf9e-9e29-4d5f-b0f3-86ea9f23758d req-493c9368-8dbc-4122-b885-877fa77d9d77 service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-0721bf9e-9e29-4d5f-b0f3-86ea9f23758d req-493c9368-8dbc-4122-b885-877fa77d9d77 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] No waiting events found dispatching network-vif-unplugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:12:59 user nova-compute[72447]: WARNING nova.compute.manager [req-0721bf9e-9e29-4d5f-b0f3-86ea9f23758d req-493c9368-8dbc-4122-b885-877fa77d9d77 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received unexpected event network-vif-unplugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 for instance with vm_state active and task_state shelving.
Jul 31 12:12:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG os_brick.utils [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[69903adc-ad65-437c-8615-04c368800136]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e907492b-8dff-48c8-a62a-3efd374b9c89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[261ce1ce-42b6-466e-b9b5-4ba8e3a98cc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[11680cb4-522c-4469-b7eb-8b19275cdfc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:12:59 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a130575c-4c0c-48ea-9bd0-289062eaed0f]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG os_brick.utils [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] <== get_connector_properties: return (220ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Updating existing volume attachment record: c5b05b7b-3843-4cd1-9726-5e7d3416486b {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:12:59 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Instance destroyed successfully.
Jul 31 12:12:59 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Beginning cold snapshot process
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:12:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.203s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:00 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:13:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk /opt/stack/data/nova/instances/snapshots/tmpxwix6ts2/9bb3930c84454af6aabf607fef1c378b {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:00 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:13:00 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:13:00 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:13:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:13:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk /opt/stack/data/nova/instances/snapshots/tmpxwix6ts2/9bb3930c84454af6aabf607fef1c378b" returned: 0 in 0.953s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:00 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Snapshot extracted, beginning image upload
Jul 31 12:13:01 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Snapshot image upload complete
Jul 31 12:13:01 user nova-compute[72447]: INFO nova.compute.manager [None req-5bc7cc5b-29fa-40c2-b159-d6b059c5fa2d tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Took 8.35 seconds to snapshot the instance on the hypervisor.
Jul 31 12:13:01 user nova-compute[72447]: DEBUG nova.compute.manager [req-4cceb514-db3d-455b-aa52-b980c567409a req-8950a6ef-5d24-423c-a614-0beb0f86ed10 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4cceb514-db3d-455b-aa52-b980c567409a req-8950a6ef-5d24-423c-a614-0beb0f86ed10 service nova] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4cceb514-db3d-455b-aa52-b980c567409a req-8950a6ef-5d24-423c-a614-0beb0f86ed10 service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4cceb514-db3d-455b-aa52-b980c567409a req-8950a6ef-5d24-423c-a614-0beb0f86ed10 service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:01 user nova-compute[72447]: DEBUG nova.compute.manager [req-4cceb514-db3d-455b-aa52-b980c567409a req-8950a6ef-5d24-423c-a614-0beb0f86ed10 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] No waiting events found dispatching network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:13:01 user nova-compute[72447]: WARNING nova.compute.manager [req-4cceb514-db3d-455b-aa52-b980c567409a req-8950a6ef-5d24-423c-a614-0beb0f86ed10 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received unexpected event network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 for instance with vm_state active and task_state shelving_image_uploading.
Jul 31 12:13:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:04 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Snapshot image upload complete
Jul 31 12:13:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:13:04 user nova-compute[72447]: INFO nova.compute.manager [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Shelve offloading
Jul 31 12:13:04 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Instance destroyed successfully.
Jul 31 12:13:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:13:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquired lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:04 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:13:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updating instance_info_cache with network_info: [{"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Releasing lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:06 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Instance destroyed successfully.
Jul 31 12:13:06 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'resources' on Instance uuid 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-15178390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-15178390',id=4,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYYPDRHR/gPH/ucT2yXGxpVxqTbPkE2g5ngdBqVVsQXRneiTQFTLKkxDWNoAHE8HulKOLnLKDCHYFWeNIt2FIxpmf8uOCr26dtrpZLq/BxGNXnJIbfPwJnHwEHuDQ42NQ==',key_name='tempest-keypair-2138130535',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8b8dd0d543cb4786afc39e88f440e538',ramdisk_id='',reservation_id='r-e7ubc06s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1971436108',owner_user_name='tempest-AttachVolumeShelveTestJSON-1971436108-project-member',shelved_at='2023-07-31T12:13:04.415514',shelved_host='user',shelved_image_id='84b867b2-9d98-40c4-a8db-7bbf5024f4ff'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:13:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc465160a3a94498ab1aa3aa44280b12',uuid=6c701045-e520-421f-94d2-b54edd0d5c54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converting VIF {"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG os_vif [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9c41aee-bb, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:13:06 user nova-compute[72447]: INFO os_vif [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb')
Jul 31 12:13:06 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Deleting instance files /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54_del
Jul 31 12:13:06 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Deletion of /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54_del complete
Jul 31 12:13:06 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Deleted allocations for instance 6c701045-e520-421f-94d2-b54edd0d5c54
Jul 31 12:13:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-a62943bb-3514-4115-bb85-de1d3f58ebf9 req-532fd88a-2a51-46b2-b965-6c24b26714b0 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-changed-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-a62943bb-3514-4115-bb85-de1d3f58ebf9 req-532fd88a-2a51-46b2-b965-6c24b26714b0 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Refreshing instance network info cache due to event network-changed-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a62943bb-3514-4115-bb85-de1d3f58ebf9 req-532fd88a-2a51-46b2-b965-6c24b26714b0 service nova] Acquiring lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a62943bb-3514-4115-bb85-de1d3f58ebf9 req-532fd88a-2a51-46b2-b965-6c24b26714b0 service nova] Acquired lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-a62943bb-3514-4115-bb85-de1d3f58ebf9 req-532fd88a-2a51-46b2-b965-6c24b26714b0 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Refreshing network info cache for port c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-a62943bb-3514-4115-bb85-de1d3f58ebf9 req-532fd88a-2a51-46b2-b965-6c24b26714b0 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updated VIF entry in instance network info cache for port c9c41aee-bb54-4d97-8f69-9dd65e2c97b7. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-a62943bb-3514-4115-bb85-de1d3f58ebf9 req-532fd88a-2a51-46b2-b965-6c24b26714b0 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updating instance_info_cache with network_info: [{"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e16a38f4-fb4c-4336-a8b0-8f2e2efb8faa tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "6c701045-e520-421f-94d2-b54edd0d5c54" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.093s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a62943bb-3514-4115-bb85-de1d3f58ebf9 req-532fd88a-2a51-46b2-b965-6c24b26714b0 service nova] Releasing lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBcJpXds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:09 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:09 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:09 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd83c873-fdbb-48ac-9d61-e7733fbaa59f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:13:09 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fb2b85-eba7-425a-9200-930ccd11a173]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2] added
Jul 31 12:13:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[080acbaa-e8f2-4ea0-97c6-18a3a3676745]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5d6bf2-f3ea-4f0c-bb67-9c4dfbec5767]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBcJpXds {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBcJpXds" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bdb96a-07bd-4811-8a79-701deaf0acb3]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LBcJpXds'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab301492-1276-4862-89fe-e3d09601aeb7]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6182db5a-db50-4343-999c-62d6c29cc83a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[021aa0fc-3a68-43ee-abe2-0d50238c1108]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2, portal: 172.16.0.220,3260]
Jul 31 12:13:09 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2, portal: 172.16.0.220,3260] successful.
Jul 31 12:13:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f389ec-9153-4a8d-aec9-f6fa6b4d13a8]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bc4d72-02f3-4ff1-bf9c-d9945045841b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:09 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d6ba7a-9fa2-4e09-9667-746d60182fd7]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:13:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBcJpXds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:13:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23339383533383137', 'path': '/dev/sdh'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339383533383137', 'path': '/dev/sdh'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:13:10 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'flavor' on Instance uuid ba0c6dba-0035-4196-a05f-9335436fac86 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:13:10 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:13:10 user nova-compute[72447]:   <source dev="/dev/sdh"/>
Jul 31 12:13:10 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:13:10 user nova-compute[72447]:   <serial>35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2</serial>
Jul 31 12:13:10 user nova-compute[72447]: </disk>
Jul 31 12:13:10 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:13:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No VIF found with MAC fa:16:3e:62:fc:84, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:13:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0a934ba2-18da-486a-844e-e5556f7ee6b8 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "ba0c6dba-0035-4196-a05f-9335436fac86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.938s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "10919978-d29f-42b7-b091-309d7202b6ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "10919978-d29f-42b7-b091-309d7202b6ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:13:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:13:14 user nova-compute[72447]: INFO nova.compute.claims [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Claim successful on node user
Jul 31 12:13:14 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805579.6252787, 6c701045-e520-421f-94d2-b54edd0d5c54 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:13:14 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] VM Stopped (Lifecycle Event)
Jul 31 12:13:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-05866771-65e4-4fda-9dcb-6914d97fa1d8 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:13:14 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:13:14 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG nova.network.neutron [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:13:15 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:13:15 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG nova.policy [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a7feffde0f74f63a6bd027c1958aacb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fad40b5f5e54e7ab9c6f8e78ceb3947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:13:15 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Creating image(s)
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "/opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "/opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "/opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.191s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk 1073741824" returned: 0 in 0.055s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG nova.network.neutron [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Successfully created port: 697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Cannot resize image /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:13:15 user nova-compute[72447]: DEBUG nova.objects.instance [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'migration_context' on Instance uuid 10919978-d29f-42b7-b091-309d7202b6ce {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Ensure instance console log exists: /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG nova.network.neutron [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Successfully updated port: 697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "refresh_cache-10919978-d29f-42b7-b091-309d7202b6ce" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquired lock "refresh_cache-10919978-d29f-42b7-b091-309d7202b6ce" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG nova.network.neutron [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG nova.compute.manager [req-6cc1dc72-7c80-40fe-b820-95bd5970886c req-2c064c02-07b9-40ca-9742-f8ca52004c24 service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Received event network-changed-697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG nova.compute.manager [req-6cc1dc72-7c80-40fe-b820-95bd5970886c req-2c064c02-07b9-40ca-9742-f8ca52004c24 service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Refreshing instance network info cache due to event network-changed-697310a1-2921-4793-82f2-b5371e4d61e8. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6cc1dc72-7c80-40fe-b820-95bd5970886c req-2c064c02-07b9-40ca-9742-f8ca52004c24 service nova] Acquiring lock "refresh_cache-10919978-d29f-42b7-b091-309d7202b6ce" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:16 user nova-compute[72447]: DEBUG nova.network.neutron [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.network.neutron [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Updating instance_info_cache with network_info: [{"id": "697310a1-2921-4793-82f2-b5371e4d61e8", "address": "fa:16:3e:bc:85:df", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697310a1-29", "ovs_interfaceid": "697310a1-2921-4793-82f2-b5371e4d61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Releasing lock "refresh_cache-10919978-d29f-42b7-b091-309d7202b6ce" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Instance network_info: |[{"id": "697310a1-2921-4793-82f2-b5371e4d61e8", "address": "fa:16:3e:bc:85:df", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697310a1-29", "ovs_interfaceid": "697310a1-2921-4793-82f2-b5371e4d61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6cc1dc72-7c80-40fe-b820-95bd5970886c req-2c064c02-07b9-40ca-9742-f8ca52004c24 service nova] Acquired lock "refresh_cache-10919978-d29f-42b7-b091-309d7202b6ce" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.network.neutron [req-6cc1dc72-7c80-40fe-b820-95bd5970886c req-2c064c02-07b9-40ca-9742-f8ca52004c24 service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Refreshing network info cache for port 697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Start _get_guest_xml network_info=[{"id": "697310a1-2921-4793-82f2-b5371e4d61e8", "address": "fa:16:3e:bc:85:df", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697310a1-29", "ovs_interfaceid": "697310a1-2921-4793-82f2-b5371e4d61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:13:17 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:13:17 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1105524451',display_name='tempest-AttachVolumeNegativeTest-server-1105524451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1105524451',id=13,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK54uqhtDVYUnyn5Tg6n0ZX5zxyT0H96D2HvAxDHq4OXU+g3rXAsOoCW2bEYboOnDPtyeEPlhH8IJrEbA/qshjJY+q/Jd4KB7UqE30FJilAchrUA8SsR3wvNyVgY6xVDew==',key_name='tempest-keypair-1089878780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fad40b5f5e54e7ab9c6f8e78ceb3947',ramdisk_id='',reservation_id='r-dm79r8b1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323727931',owner_user_name='tempest-AttachVolumeNegativeTest-323727931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:13:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a7feffde0f74f63a6bd027c1958aacb',uuid=10919978-d29f-42b7-b091-309d7202b6ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "697310a1-2921-4793-82f2-b5371e4d61e8", "address": "fa:16:3e:bc:85:df", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697310a1-29", "ovs_interfaceid": "697310a1-2921-4793-82f2-b5371e4d61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converting VIF {"id": "697310a1-2921-4793-82f2-b5371e4d61e8", "address": "fa:16:3e:bc:85:df", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697310a1-29", "ovs_interfaceid": "697310a1-2921-4793-82f2-b5371e4d61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:85:df,bridge_name='br-int',has_traffic_filtering=True,id=697310a1-2921-4793-82f2-b5371e4d61e8,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697310a1-29') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.objects.instance [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'pci_devices' on Instance uuid 10919978-d29f-42b7-b091-309d7202b6ce {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:13:17 user nova-compute[72447]:   <uuid>10919978-d29f-42b7-b091-309d7202b6ce</uuid>
Jul 31 12:13:17 user nova-compute[72447]:   <name>instance-0000000d</name>
Jul 31 12:13:17 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:13:17 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:13:17 user nova-compute[72447]:   <metadata>
Jul 31 12:13:17 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:13:17 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:13:17 user nova-compute[72447]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1105524451</nova:name>
Jul 31 12:13:17 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:13:17</nova:creationTime>
Jul 31 12:13:17 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:13:17 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:13:17 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:13:17 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:13:17 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:13:17 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:13:17 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:13:17 user nova-compute[72447]:       <nova:owner>
Jul 31 12:13:17 user nova-compute[72447]:         <nova:user uuid="6a7feffde0f74f63a6bd027c1958aacb">tempest-AttachVolumeNegativeTest-323727931-project-member</nova:user>
Jul 31 12:13:17 user nova-compute[72447]:         <nova:project uuid="7fad40b5f5e54e7ab9c6f8e78ceb3947">tempest-AttachVolumeNegativeTest-323727931</nova:project>
Jul 31 12:13:17 user nova-compute[72447]:       </nova:owner>
Jul 31 12:13:17 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:13:17 user nova-compute[72447]:       <nova:ports>
Jul 31 12:13:17 user nova-compute[72447]:         <nova:port uuid="697310a1-2921-4793-82f2-b5371e4d61e8">
Jul 31 12:13:17 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:13:17 user nova-compute[72447]:         </nova:port>
Jul 31 12:13:17 user nova-compute[72447]:       </nova:ports>
Jul 31 12:13:17 user nova-compute[72447]:     </nova:instance>
Jul 31 12:13:17 user nova-compute[72447]:   </metadata>
Jul 31 12:13:17 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:13:17 user nova-compute[72447]:     <system>
Jul 31 12:13:17 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:13:17 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:13:17 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:13:17 user nova-compute[72447]:       <entry name="serial">10919978-d29f-42b7-b091-309d7202b6ce</entry>
Jul 31 12:13:17 user nova-compute[72447]:       <entry name="uuid">10919978-d29f-42b7-b091-309d7202b6ce</entry>
Jul 31 12:13:17 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:13:17 user nova-compute[72447]:     </system>
Jul 31 12:13:17 user nova-compute[72447]:   </sysinfo>
Jul 31 12:13:17 user nova-compute[72447]:   <os>
Jul 31 12:13:17 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:13:17 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:13:17 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:13:17 user nova-compute[72447]:   </os>
Jul 31 12:13:17 user nova-compute[72447]:   <features>
Jul 31 12:13:17 user nova-compute[72447]:     <acpi/>
Jul 31 12:13:17 user nova-compute[72447]:     <apic/>
Jul 31 12:13:17 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:13:17 user nova-compute[72447]:   </features>
Jul 31 12:13:17 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:13:17 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:13:17 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:13:17 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:13:17 user nova-compute[72447]:   </clock>
Jul 31 12:13:17 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:13:17 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:13:17 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:13:17 user nova-compute[72447]:   </cpu>
Jul 31 12:13:17 user nova-compute[72447]:   <devices>
Jul 31 12:13:17 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:13:17 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:13:17 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk"/>
Jul 31 12:13:17 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:13:17 user nova-compute[72447]:     </disk>
Jul 31 12:13:17 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:13:17 user nova-compute[72447]:       <mac address="fa:16:3e:bc:85:df"/>
Jul 31 12:13:17 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:13:17 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:13:17 user nova-compute[72447]:       <target dev="tap697310a1-29"/>
Jul 31 12:13:17 user nova-compute[72447]:     </interface>
Jul 31 12:13:17 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:13:17 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/console.log" append="off"/>
Jul 31 12:13:17 user nova-compute[72447]:     </serial>
Jul 31 12:13:17 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:13:17 user nova-compute[72447]:     <video>
Jul 31 12:13:17 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:13:17 user nova-compute[72447]:     </video>
Jul 31 12:13:17 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:13:17 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:13:17 user nova-compute[72447]:     </rng>
Jul 31 12:13:17 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:13:17 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:13:17 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:13:17 user nova-compute[72447]:     </memballoon>
Jul 31 12:13:17 user nova-compute[72447]:   </devices>
Jul 31 12:13:17 user nova-compute[72447]: </domain>
Jul 31 12:13:17 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1105524451',display_name='tempest-AttachVolumeNegativeTest-server-1105524451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1105524451',id=13,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK54uqhtDVYUnyn5Tg6n0ZX5zxyT0H96D2HvAxDHq4OXU+g3rXAsOoCW2bEYboOnDPtyeEPlhH8IJrEbA/qshjJY+q/Jd4KB7UqE30FJilAchrUA8SsR3wvNyVgY6xVDew==',key_name='tempest-keypair-1089878780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fad40b5f5e54e7ab9c6f8e78ceb3947',ramdisk_id='',reservation_id='r-dm79r8b1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323727931',owner_user_name='tempest-AttachVolumeNegativeTest-323727931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:13:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a7feffde0f74f63a6bd027c1958aacb',uuid=10919978-d29f-42b7-b091-309d7202b6ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "697310a1-2921-4793-82f2-b5371e4d61e8", "address": "fa:16:3e:bc:85:df", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697310a1-29", "ovs_interfaceid": "697310a1-2921-4793-82f2-b5371e4d61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converting VIF {"id": "697310a1-2921-4793-82f2-b5371e4d61e8", "address": "fa:16:3e:bc:85:df", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697310a1-29", "ovs_interfaceid": "697310a1-2921-4793-82f2-b5371e4d61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:85:df,bridge_name='br-int',has_traffic_filtering=True,id=697310a1-2921-4793-82f2-b5371e4d61e8,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697310a1-29') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG os_vif [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:85:df,bridge_name='br-int',has_traffic_filtering=True,id=697310a1-2921-4793-82f2-b5371e4d61e8,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697310a1-29') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap697310a1-29, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap697310a1-29, col_values=(('external_ids', {'iface-id': '697310a1-2921-4793-82f2-b5371e4d61e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:85:df', 'vm-uuid': '10919978-d29f-42b7-b091-309d7202b6ce'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:17 user nova-compute[72447]: INFO os_vif [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:85:df,bridge_name='br-int',has_traffic_filtering=True,id=697310a1-2921-4793-82f2-b5371e4d61e8,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697310a1-29')
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No VIF found with MAC fa:16:3e:bc:85:df, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-a142bf13-278d-4164-aec0-810f4ee82baf req-b7e1e10b-f44e-487d-b813-4493e95aa70a service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Received event network-changed-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-a142bf13-278d-4164-aec0-810f4ee82baf req-b7e1e10b-f44e-487d-b813-4493e95aa70a service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Refreshing instance network info cache due to event network-changed-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a142bf13-278d-4164-aec0-810f4ee82baf req-b7e1e10b-f44e-487d-b813-4493e95aa70a service nova] Acquiring lock "refresh_cache-fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a142bf13-278d-4164-aec0-810f4ee82baf req-b7e1e10b-f44e-487d-b813-4493e95aa70a service nova] Acquired lock "refresh_cache-fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.network.neutron [req-a142bf13-278d-4164-aec0-810f4ee82baf req-b7e1e10b-f44e-487d-b813-4493e95aa70a service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Refreshing network info cache for port c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.network.neutron [req-6cc1dc72-7c80-40fe-b820-95bd5970886c req-2c064c02-07b9-40ca-9742-f8ca52004c24 service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Updated VIF entry in instance network info cache for port 697310a1-2921-4793-82f2-b5371e4d61e8. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG nova.network.neutron [req-6cc1dc72-7c80-40fe-b820-95bd5970886c req-2c064c02-07b9-40ca-9742-f8ca52004c24 service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Updating instance_info_cache with network_info: [{"id": "697310a1-2921-4793-82f2-b5371e4d61e8", "address": "fa:16:3e:bc:85:df", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697310a1-29", "ovs_interfaceid": "697310a1-2921-4793-82f2-b5371e4d61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6cc1dc72-7c80-40fe-b820-95bd5970886c req-2c064c02-07b9-40ca-9742-f8ca52004c24 service nova] Releasing lock "refresh_cache-10919978-d29f-42b7-b091-309d7202b6ce" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:18 user nova-compute[72447]: DEBUG nova.network.neutron [req-a142bf13-278d-4164-aec0-810f4ee82baf req-b7e1e10b-f44e-487d-b813-4493e95aa70a service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Updated VIF entry in instance network info cache for port c69205df-b8b2-4c1d-a7d5-aa4fff4b2476. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:13:18 user nova-compute[72447]: DEBUG nova.network.neutron [req-a142bf13-278d-4164-aec0-810f4ee82baf req-b7e1e10b-f44e-487d-b813-4493e95aa70a service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Updating instance_info_cache with network_info: [{"id": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "address": "fa:16:3e:d7:54:1c", "network": {"id": "891f8f1e-f53f-46a2-82a6-daa0b2a69504", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-521582482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e410fe41c47169d8587fda6d752a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69205df-b8", "ovs_interfaceid": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a142bf13-278d-4164-aec0-810f4ee82baf req-b7e1e10b-f44e-487d-b813-4493e95aa70a service nova] Releasing lock "refresh_cache-fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-46b51a69-6901-4b90-85fd-ad93fe5e97c9 req-49538c7a-bfb4-47cb-a38b-9a6bc5925cd0 service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Received event network-vif-plugged-697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-46b51a69-6901-4b90-85fd-ad93fe5e97c9 req-49538c7a-bfb4-47cb-a38b-9a6bc5925cd0 service nova] Acquiring lock "10919978-d29f-42b7-b091-309d7202b6ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-46b51a69-6901-4b90-85fd-ad93fe5e97c9 req-49538c7a-bfb4-47cb-a38b-9a6bc5925cd0 service nova] Lock "10919978-d29f-42b7-b091-309d7202b6ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-46b51a69-6901-4b90-85fd-ad93fe5e97c9 req-49538c7a-bfb4-47cb-a38b-9a6bc5925cd0 service nova] Lock "10919978-d29f-42b7-b091-309d7202b6ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-46b51a69-6901-4b90-85fd-ad93fe5e97c9 req-49538c7a-bfb4-47cb-a38b-9a6bc5925cd0 service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] No waiting events found dispatching network-vif-plugged-697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:13:19 user nova-compute[72447]: WARNING nova.compute.manager [req-46b51a69-6901-4b90-85fd-ad93fe5e97c9 req-49538c7a-bfb4-47cb-a38b-9a6bc5925cd0 service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Received unexpected event network-vif-plugged-697310a1-2921-4793-82f2-b5371e4d61e8 for instance with vm_state building and task_state spawning.
Jul 31 12:13:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805601.1229997, 10919978-d29f-42b7-b091-309d7202b6ce => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:13:21 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] VM Resumed (Lifecycle Event)
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:13:21 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Instance spawned successfully.
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:13:21 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805601.124815, 10919978-d29f-42b7-b091-309d7202b6ce => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:13:21 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] VM Started (Lifecycle Event)
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:13:21 user nova-compute[72447]: INFO nova.compute.manager [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Took 6.02 seconds to spawn the instance on the hypervisor.
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-3257b63a-1e45-4ba4-b323-de771a17a9d1 req-67fde1d5-65d7-4895-bf50-20fce93be219 service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Received event network-vif-plugged-697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3257b63a-1e45-4ba4-b323-de771a17a9d1 req-67fde1d5-65d7-4895-bf50-20fce93be219 service nova] Acquiring lock "10919978-d29f-42b7-b091-309d7202b6ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3257b63a-1e45-4ba4-b323-de771a17a9d1 req-67fde1d5-65d7-4895-bf50-20fce93be219 service nova] Lock "10919978-d29f-42b7-b091-309d7202b6ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3257b63a-1e45-4ba4-b323-de771a17a9d1 req-67fde1d5-65d7-4895-bf50-20fce93be219 service nova] Lock "10919978-d29f-42b7-b091-309d7202b6ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-3257b63a-1e45-4ba4-b323-de771a17a9d1 req-67fde1d5-65d7-4895-bf50-20fce93be219 service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] No waiting events found dispatching network-vif-plugged-697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:13:21 user nova-compute[72447]: WARNING nova.compute.manager [req-3257b63a-1e45-4ba4-b323-de771a17a9d1 req-67fde1d5-65d7-4895-bf50-20fce93be219 service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Received unexpected event network-vif-plugged-697310a1-2921-4793-82f2-b5371e4d61e8 for instance with vm_state building and task_state spawning.
Jul 31 12:13:21 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lazy-loading 'flavor' on Instance uuid fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:21 user nova-compute[72447]: INFO nova.compute.manager [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Took 6.86 seconds to build instance.
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7001a184-8b63-4da5-a2d5-686a1a5ca56a tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "10919978-d29f-42b7-b091-309d7202b6ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.952s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-a3c3fd55-ec20-4577-98f8-426ddcd44c14 req-0f678524-1005-415e-b6bf-bd5961e78072 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Received event network-changed-29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-a3c3fd55-ec20-4577-98f8-426ddcd44c14 req-0f678524-1005-415e-b6bf-bd5961e78072 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Refreshing instance network info cache due to event network-changed-29928bd0-ae23-4a93-ba76-d4df44512908. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a3c3fd55-ec20-4577-98f8-426ddcd44c14 req-0f678524-1005-415e-b6bf-bd5961e78072 service nova] Acquiring lock "refresh_cache-700d80d6-9248-4d6f-9010-c3904d8fec2c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a3c3fd55-ec20-4577-98f8-426ddcd44c14 req-0f678524-1005-415e-b6bf-bd5961e78072 service nova] Acquired lock "refresh_cache-700d80d6-9248-4d6f-9010-c3904d8fec2c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.network.neutron [req-a3c3fd55-ec20-4577-98f8-426ddcd44c14 req-0f678524-1005-415e-b6bf-bd5961e78072 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Refreshing network info cache for port 29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:21 user nova-compute[72447]: INFO nova.compute.manager [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Attaching volume dbb2afda-cd16-4052-8c8f-6b5014d4e5ef to /dev/sdc
Jul 31 12:13:21 user nova-compute[72447]: DEBUG os_brick.utils [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[99943793-72da-4282-9c9f-757222f87c8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-bb0064dd-d514-46e8-9201-3ed13bd9b8fe req-136233eb-5e10-4469-81e5-5c078fa0d5f1 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-changed-4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-bb0064dd-d514-46e8-9201-3ed13bd9b8fe req-136233eb-5e10-4469-81e5-5c078fa0d5f1 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Refreshing instance network info cache due to event network-changed-4607d653-6d85-46b9-b00e-39748d9afb78. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bb0064dd-d514-46e8-9201-3ed13bd9b8fe req-136233eb-5e10-4469-81e5-5c078fa0d5f1 service nova] Acquiring lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bb0064dd-d514-46e8-9201-3ed13bd9b8fe req-136233eb-5e10-4469-81e5-5c078fa0d5f1 service nova] Acquired lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.network.neutron [req-bb0064dd-d514-46e8-9201-3ed13bd9b8fe req-136233eb-5e10-4469-81e5-5c078fa0d5f1 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Refreshing network info cache for port 4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7bb79a-13c6-4b73-96b9-7f293ada61ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.objects.instance [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lazy-loading 'flavor' on Instance uuid 700d80d6-9248-4d6f-9010-c3904d8fec2c {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[56316ab5-bcda-4759-b41f-c04254b4a06d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[104001dd-cd8e-4cb4-8581-236947b4de29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:13:21 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:13:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dffc4c0-59ee-435a-bdd1-3c62a857b62d]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG os_brick.utils [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:21 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Updating existing volume attachment record: 7a15f444-2f1c-4e0e-aba1-0fc4ea2f6d5f {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.163s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.007s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:22 user nova-compute[72447]: INFO nova.compute.manager [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Attaching volume 98d2481b-ed84-43c9-af4e-c98f04982110 to /dev/vdb
Jul 31 12:13:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG nova.network.neutron [req-a3c3fd55-ec20-4577-98f8-426ddcd44c14 req-0f678524-1005-415e-b6bf-bd5961e78072 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Updated VIF entry in instance network info cache for port 29928bd0-ae23-4a93-ba76-d4df44512908. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG nova.network.neutron [req-a3c3fd55-ec20-4577-98f8-426ddcd44c14 req-0f678524-1005-415e-b6bf-bd5961e78072 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Updating instance_info_cache with network_info: [{"id": "29928bd0-ae23-4a93-ba76-d4df44512908", "address": "fa:16:3e:35:f3:1f", "network": {"id": "9e4d5fcf-1179-404a-97a7-bf749934d047", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1726752963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639d35cc656e4dae8c062e531e6d2dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29928bd0-ae", "ovs_interfaceid": "29928bd0-ae23-4a93-ba76-d4df44512908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG os_brick.utils [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[391201a0-3c93-419b-8df9-14977313b7f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a3c3fd55-ec20-4577-98f8-426ddcd44c14 req-0f678524-1005-415e-b6bf-bd5961e78072 service nova] Releasing lock "refresh_cache-700d80d6-9248-4d6f-9010-c3904d8fec2c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd72e32-7a40-453b-b7fe-93476e1ee576]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d30f6ae-a81b-4990-8af5-4625704937aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[70265e0a-7804-45d3-a511-f1422b63c720]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:13:22 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bcf125-9411-4c12-9dbf-c9fff3a470f4]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG os_brick.utils [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Updating existing volume attachment record: cfcfbc77-54cf-4e0e-a9a8-e36d6ee368df {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "interface-b8929e20-a1f2-4a9c-a0c8-e0241113f0af-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "interface-b8929e20-a1f2-4a9c-a0c8-e0241113f0af-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lazy-loading 'flavor' on Instance uuid b8929e20-a1f2-4a9c-a0c8-e0241113f0af {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG nova.network.neutron [req-bb0064dd-d514-46e8-9201-3ed13bd9b8fe req-136233eb-5e10-4469-81e5-5c078fa0d5f1 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Updated VIF entry in instance network info cache for port 4607d653-6d85-46b9-b00e-39748d9afb78. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG nova.network.neutron [req-bb0064dd-d514-46e8-9201-3ed13bd9b8fe req-136233eb-5e10-4469-81e5-5c078fa0d5f1 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Updating instance_info_cache with network_info: [{"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bb0064dd-d514-46e8-9201-3ed13bd9b8fe req-136233eb-5e10-4469-81e5-5c078fa0d5f1 service nova] Releasing lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:23 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lazy-loading 'pci_requests' on Instance uuid b8929e20-a1f2-4a9c-a0c8-e0241113f0af {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:13:23 user nova-compute[72447]: DEBUG nova.policy [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd71c3e48f72842709366c6ad635fca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a05f78f7104db98fe0e537d3f22208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:13:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Successfully created port: de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:13:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:24 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Successfully updated port: de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:13:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquired lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:24 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:13:24 user nova-compute[72447]: DEBUG nova.compute.manager [req-9ad3263a-148c-4108-a166-41480744c797 req-e31038db-70a5-4331-bbc2-4bed356af1d7 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-changed-de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:24 user nova-compute[72447]: DEBUG nova.compute.manager [req-9ad3263a-148c-4108-a166-41480744c797 req-e31038db-70a5-4331-bbc2-4bed356af1d7 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Refreshing instance network info cache due to event network-changed-de27da5d-b9c5-449f-858a-2d27d62e2527. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:13:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9ad3263a-148c-4108-a166-41480744c797 req-e31038db-70a5-4331-bbc2-4bed356af1d7 service nova] Acquiring lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Updating instance_info_cache with network_info: [{"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de27da5d-b9c5-449f-858a-2d27d62e2527", "address": "fa:16:3e:2c:a1:85", "network": {"id": "5d341115-50ea-47df-8221-00d1580b132a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2104785291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde27da5d-b9", "ovs_interfaceid": "de27da5d-b9c5-449f-858a-2d27d62e2527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Releasing lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9ad3263a-148c-4108-a166-41480744c797 req-e31038db-70a5-4331-bbc2-4bed356af1d7 service nova] Acquired lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG nova.network.neutron [req-9ad3263a-148c-4108-a166-41480744c797 req-e31038db-70a5-4331-bbc2-4bed356af1d7 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Refreshing network info cache for port de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1947605890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1947605890',id=7,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn5YeitERNgZiavoklE86RU3W69tKvanqOuX1Z4JM4bRcMNOeZRTBb//da8RjvsuxuqMZXyuEd1IjLCPuMWJJvrbNo/sdXOTs0iSDWka1Ds3bPHY+Kbf22pgZ3qNjgNdg==',key_name='tempest-keypair-117256101',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9a05f78f7104db98fe0e537d3f22208',ramdisk_id='',reservation_id='r-7n456tj0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1246153700',owner_user_name='tempest-TaggedAttachmentsTest-1246153700-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d71c3e48f72842709366c6ad635fca49',uuid=b8929e20-a1f2-4a9c-a0c8-e0241113f0af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de27da5d-b9c5-449f-858a-2d27d62e2527", "address": "fa:16:3e:2c:a1:85", "network": {"id": "5d341115-50ea-47df-8221-00d1580b132a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2104785291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde27da5d-b9", "ovs_interfaceid": "de27da5d-b9c5-449f-858a-2d27d62e2527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converting VIF {"id": "de27da5d-b9c5-449f-858a-2d27d62e2527", "address": "fa:16:3e:2c:a1:85", "network": {"id": "5d341115-50ea-47df-8221-00d1580b132a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2104785291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde27da5d-b9", "ovs_interfaceid": "de27da5d-b9c5-449f-858a-2d27d62e2527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:85,bridge_name='br-int',has_traffic_filtering=True,id=de27da5d-b9c5-449f-858a-2d27d62e2527,network=Network(5d341115-50ea-47df-8221-00d1580b132a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde27da5d-b9') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG os_vif [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:85,bridge_name='br-int',has_traffic_filtering=True,id=de27da5d-b9c5-449f-858a-2d27d62e2527,network=Network(5d341115-50ea-47df-8221-00d1580b132a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde27da5d-b9') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde27da5d-b9, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde27da5d-b9, col_values=(('external_ids', {'iface-id': 'de27da5d-b9c5-449f-858a-2d27d62e2527', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:a1:85', 'vm-uuid': 'b8929e20-a1f2-4a9c-a0c8-e0241113f0af'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:25 user nova-compute[72447]: INFO os_vif [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:85,bridge_name='br-int',has_traffic_filtering=True,id=de27da5d-b9c5-449f-858a-2d27d62e2527,network=Network(5d341115-50ea-47df-8221-00d1580b132a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde27da5d-b9')
Jul 31 12:13:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1947605890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1947605890',id=7,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn5YeitERNgZiavoklE86RU3W69tKvanqOuX1Z4JM4bRcMNOeZRTBb//da8RjvsuxuqMZXyuEd1IjLCPuMWJJvrbNo/sdXOTs0iSDWka1Ds3bPHY+Kbf22pgZ3qNjgNdg==',key_name='tempest-keypair-117256101',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9a05f78f7104db98fe0e537d3f22208',ramdisk_id='',reservation_id='r-7n456tj0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1246153700',owner_user_name='tempest-TaggedAttachmentsTest-1246153700-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d71c3e48f72842709366c6ad635fca49',uuid=b8929e20-a1f2-4a9c-a0c8-e0241113f0af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de27da5d-b9c5-449f-858a-2d27d62e2527", "address": "fa:16:3e:2c:a1:85", "network": {"id": "5d341115-50ea-47df-8221-00d1580b132a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2104785291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde27da5d-b9", "ovs_interfaceid": "de27da5d-b9c5-449f-858a-2d27d62e2527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converting VIF {"id": "de27da5d-b9c5-449f-858a-2d27d62e2527", "address": "fa:16:3e:2c:a1:85", "network": {"id": "5d341115-50ea-47df-8221-00d1580b132a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2104785291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde27da5d-b9", "ovs_interfaceid": "de27da5d-b9c5-449f-858a-2d27d62e2527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:85,bridge_name='br-int',has_traffic_filtering=True,id=de27da5d-b9c5-449f-858a-2d27d62e2527,network=Network(5d341115-50ea-47df-8221-00d1580b132a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde27da5d-b9') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] attach device xml: <interface type="ethernet">
Jul 31 12:13:25 user nova-compute[72447]:   <mac address="fa:16:3e:2c:a1:85"/>
Jul 31 12:13:25 user nova-compute[72447]:   <model type="virtio"/>
Jul 31 12:13:25 user nova-compute[72447]:   <mtu size="1442"/>
Jul 31 12:13:25 user nova-compute[72447]:   <target dev="tapde27da5d-b9"/>
Jul 31 12:13:25 user nova-compute[72447]: </interface>
Jul 31 12:13:25 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] No BDM found with device name hda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] No VIF found with MAC fa:16:3e:46:a9:05, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:13:26 user nova-compute[72447]:   <nova:package version="0.0.0"/>
Jul 31 12:13:26 user nova-compute[72447]:   <nova:name>tempest-device-tagging-server-1947605890</nova:name>
Jul 31 12:13:26 user nova-compute[72447]:   <nova:creationTime>2023-07-31 12:13:26</nova:creationTime>
Jul 31 12:13:26 user nova-compute[72447]:   <nova:flavor name="m1.tiny">
Jul 31 12:13:26 user nova-compute[72447]:     <nova:memory>512</nova:memory>
Jul 31 12:13:26 user nova-compute[72447]:     <nova:disk>1</nova:disk>
Jul 31 12:13:26 user nova-compute[72447]:     <nova:swap>0</nova:swap>
Jul 31 12:13:26 user nova-compute[72447]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:13:26 user nova-compute[72447]:     <nova:vcpus>1</nova:vcpus>
Jul 31 12:13:26 user nova-compute[72447]:   </nova:flavor>
Jul 31 12:13:26 user nova-compute[72447]:   <nova:owner>
Jul 31 12:13:26 user nova-compute[72447]:     <nova:user uuid="d71c3e48f72842709366c6ad635fca49">tempest-TaggedAttachmentsTest-1246153700-project-member</nova:user>
Jul 31 12:13:26 user nova-compute[72447]:     <nova:project uuid="f9a05f78f7104db98fe0e537d3f22208">tempest-TaggedAttachmentsTest-1246153700</nova:project>
Jul 31 12:13:26 user nova-compute[72447]:   </nova:owner>
Jul 31 12:13:26 user nova-compute[72447]:   <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:13:26 user nova-compute[72447]:   <nova:ports>
Jul 31 12:13:26 user nova-compute[72447]:     <nova:port uuid="4607d653-6d85-46b9-b00e-39748d9afb78">
Jul 31 12:13:26 user nova-compute[72447]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:13:26 user nova-compute[72447]:     </nova:port>
Jul 31 12:13:26 user nova-compute[72447]:     <nova:port uuid="de27da5d-b9c5-449f-858a-2d27d62e2527">
Jul 31 12:13:26 user nova-compute[72447]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Jul 31 12:13:26 user nova-compute[72447]:     </nova:port>
Jul 31 12:13:26 user nova-compute[72447]:   </nova:ports>
Jul 31 12:13:26 user nova-compute[72447]: </nova:instance>
Jul 31 12:13:26 user nova-compute[72447]:  {{(pid=72447) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e640aba6-ab3b-4d4c-b093-7534220f5847 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "interface-b8929e20-a1f2-4a9c-a0c8-e0241113f0af-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.536s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG nova.network.neutron [req-9ad3263a-148c-4108-a166-41480744c797 req-e31038db-70a5-4331-bbc2-4bed356af1d7 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Updated VIF entry in instance network info cache for port de27da5d-b9c5-449f-858a-2d27d62e2527. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG nova.network.neutron [req-9ad3263a-148c-4108-a166-41480744c797 req-e31038db-70a5-4331-bbc2-4bed356af1d7 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Updating instance_info_cache with network_info: [{"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de27da5d-b9c5-449f-858a-2d27d62e2527", "address": "fa:16:3e:2c:a1:85", "network": {"id": "5d341115-50ea-47df-8221-00d1580b132a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2104785291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde27da5d-b9", "ovs_interfaceid": "de27da5d-b9c5-449f-858a-2d27d62e2527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9ad3263a-148c-4108-a166-41480744c797 req-e31038db-70a5-4331-bbc2-4bed356af1d7 service nova] Releasing lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG nova.objects.instance [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lazy-loading 'flavor' on Instance uuid b8929e20-a1f2-4a9c-a0c8-e0241113f0af {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-d54e07b0-cc3c-43ed-93a4-791f110753f2 req-070811be-4574-4acb-92fa-0bc7f7e96660 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-vif-plugged-de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d54e07b0-cc3c-43ed-93a4-791f110753f2 req-070811be-4574-4acb-92fa-0bc7f7e96660 service nova] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d54e07b0-cc3c-43ed-93a4-791f110753f2 req-070811be-4574-4acb-92fa-0bc7f7e96660 service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d54e07b0-cc3c-43ed-93a4-791f110753f2 req-070811be-4574-4acb-92fa-0bc7f7e96660 service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-d54e07b0-cc3c-43ed-93a4-791f110753f2 req-070811be-4574-4acb-92fa-0bc7f7e96660 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] No waiting events found dispatching network-vif-plugged-de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:13:26 user nova-compute[72447]: WARNING nova.compute.manager [req-d54e07b0-cc3c-43ed-93a4-791f110753f2 req-070811be-4574-4acb-92fa-0bc7f7e96660 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received unexpected event network-vif-plugged-de27da5d-b9c5-449f-858a-2d27d62e2527 for instance with vm_state active and task_state None.
Jul 31 12:13:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-d54e07b0-cc3c-43ed-93a4-791f110753f2 req-070811be-4574-4acb-92fa-0bc7f7e96660 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-vif-plugged-de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d54e07b0-cc3c-43ed-93a4-791f110753f2 req-070811be-4574-4acb-92fa-0bc7f7e96660 service nova] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d54e07b0-cc3c-43ed-93a4-791f110753f2 req-070811be-4574-4acb-92fa-0bc7f7e96660 service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d54e07b0-cc3c-43ed-93a4-791f110753f2 req-070811be-4574-4acb-92fa-0bc7f7e96660 service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-d54e07b0-cc3c-43ed-93a4-791f110753f2 req-070811be-4574-4acb-92fa-0bc7f7e96660 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] No waiting events found dispatching network-vif-plugged-de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:13:26 user nova-compute[72447]: WARNING nova.compute.manager [req-d54e07b0-cc3c-43ed-93a4-791f110753f2 req-070811be-4574-4acb-92fa-0bc7f7e96660 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received unexpected event network-vif-plugged-de27da5d-b9c5-449f-858a-2d27d62e2527 for instance with vm_state active and task_state None.
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:26 user nova-compute[72447]: INFO nova.compute.manager [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Attaching volume 7063fd1d-f0cb-42a8-bc90-69b8a6a14585 to /dev/vdb
Jul 31 12:13:26 user nova-compute[72447]: DEBUG os_brick.utils [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[149b9308-1849-4777-a2c7-f71ca5f26fdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aaba2d-c12e-456b-a8ab-6faaf7ed850b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84d2e67-aeec-4bfa-9236-260bf6d69898]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[434531e8-9d31-4a5b-81ed-03a6066b509c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:13:27 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:13:27 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[551f1174-76db-4cac-9673-281660215344]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG os_brick.utils [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:27 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Updating existing volume attachment record: 748fa4fd-fcdf-41ae-bb8a-97ed98799867 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:13:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwuZMPeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:31 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:31 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:31 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdac5b92-d542-48ae-95f3-50c155c78daa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:13:31 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[729637cb-6ae8-4a59-a3e6-091e29212712]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110] added
Jul 31 12:13:31 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d7e420-2e08-4121-8d2d-3d1cebe6e8ae]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[337de2b5-1a9b-4263-866b-52766b311d88]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FwuZMPeb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FwuZMPeb" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7120d1e0-a387-42cd-ae74-386db57174f8]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FwuZMPeb'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f773a5d4-59d5-4bfd-8256-ac3294f52d4e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9b8b68-275f-4d97-82d7-e95ab62c3725]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:31 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:31 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:31 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:31 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:31 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:31 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:31 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:31 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:31 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:31 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:31 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:31 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:31 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:31 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04fb276-38e2-4b9d-a18a-30c4ec72230a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110, portal: 172.16.0.220,3260]
Jul 31 12:13:31 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110, portal: 172.16.0.220,3260] successful.
Jul 31 12:13:31 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e0c635-61eb-4715-a4be-1d3c9e237365]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1287a7-c0df-43f2-8cd2-696c8881925c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:32 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[36452dd1-695e-49f9-a55a-06192b5d156a]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:13:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwuZMPeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26137613432316630', 'path': '/dev/sdi'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137613432316630', 'path': '/dev/sdi'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG nova.objects.instance [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lazy-loading 'flavor' on Instance uuid 700d80d6-9248-4d6f-9010-c3904d8fec2c {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:13:33 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:13:33 user nova-compute[72447]:   <source dev="/dev/sdi"/>
Jul 31 12:13:33 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:13:33 user nova-compute[72447]:   <serial>98d2481b-ed84-43c9-af4e-c98f04982110</serial>
Jul 31 12:13:33 user nova-compute[72447]: </disk>
Jul 31 12:13:33 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-69072d3b-9ab9-42d7-85e3-fa3f765c0d31 req-9b0b34d1-2143-4d6e-b854-3855849b7c05 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Received event network-changed-5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-69072d3b-9ab9-42d7-85e3-fa3f765c0d31 req-9b0b34d1-2143-4d6e-b854-3855849b7c05 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Refreshing instance network info cache due to event network-changed-5003425a-134e-472d-92e2-420de67a84e7. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-69072d3b-9ab9-42d7-85e3-fa3f765c0d31 req-9b0b34d1-2143-4d6e-b854-3855849b7c05 service nova] Acquiring lock "refresh_cache-b2cab306-7667-47cf-a689-75ad6d6b5dc3" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-69072d3b-9ab9-42d7-85e3-fa3f765c0d31 req-9b0b34d1-2143-4d6e-b854-3855849b7c05 service nova] Acquired lock "refresh_cache-b2cab306-7667-47cf-a689-75ad6d6b5dc3" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG nova.network.neutron [req-69072d3b-9ab9-42d7-85e3-fa3f765c0d31 req-9b0b34d1-2143-4d6e-b854-3855849b7c05 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Refreshing network info cache for port 5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] No VIF found with MAC fa:16:3e:35:f3:1f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:13:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24e51f30-9068-4ff8-8e38-b81a8ad322a3 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.406s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:34 user nova-compute[72447]: DEBUG nova.network.neutron [req-69072d3b-9ab9-42d7-85e3-fa3f765c0d31 req-9b0b34d1-2143-4d6e-b854-3855849b7c05 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Updated VIF entry in instance network info cache for port 5003425a-134e-472d-92e2-420de67a84e7. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:13:34 user nova-compute[72447]: DEBUG nova.network.neutron [req-69072d3b-9ab9-42d7-85e3-fa3f765c0d31 req-9b0b34d1-2143-4d6e-b854-3855849b7c05 service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Updating instance_info_cache with network_info: [{"id": "5003425a-134e-472d-92e2-420de67a84e7", "address": "fa:16:3e:64:3f:7e", "network": {"id": "31deefaf-d6e3-4bbf-8398-236aecf427d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-89341723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36cca759ce84e3a8d8a1c33cba6a2ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5003425a-13", "ovs_interfaceid": "5003425a-134e-472d-92e2-420de67a84e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-69072d3b-9ab9-42d7-85e3-fa3f765c0d31 req-9b0b34d1-2143-4d6e-b854-3855849b7c05 service nova] Releasing lock "refresh_cache-b2cab306-7667-47cf-a689-75ad6d6b5dc3" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Acquiring lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG os_brick.utils [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e66145-429b-42bf-a7a0-8ca55cc255fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5bfe80-5f6c-42d6-b248-e2133b106e43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27a5ca2-efd0-485e-b37f-a3d09b7815d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[98708f7f-181a-4220-9a29-f06bf13a01ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:13:35 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:13:35 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fca53e-3fb9-4434-b57a-7bee730e3a62]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:13:35 user nova-compute[72447]: DEBUG os_brick.utils [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:35 user nova-compute[72447]: INFO nova.compute.manager [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Swapping volume 98d2481b-ed84-43c9-af4e-c98f04982110 for a28358f8-4d88-4fc4-a56c-16df5d2b0793
Jul 31 12:13:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDGbZkdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:36 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:36 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:36 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a04ff0-9bc7-4610-b44a-12786ff07259]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:13:36 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cf84f6-aae3-4200-96f4-ba9184a4738b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef] added
Jul 31 12:13:36 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3580a48a-b3f4-4840-b3a1-5b3a6c0e2b11]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1539df-df20-491c-8efe-25159550582a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDGbZkdf {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDGbZkdf" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f66c524-998e-435b-aec5-f3d79c6d95f3]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HDGbZkdf'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a2df25-a910-4ac2-8336-091a4133d809]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[535bc3f3-3736-4e9d-9a89-7dac16cb7841]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ac1f97-35f4-4cf0-b82c-b058a1f0a910]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef, portal: 172.16.0.220,3260]
Jul 31 12:13:36 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef, portal: 172.16.0.220,3260] successful.
Jul 31 12:13:36 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0621b3b-c568-4e8e-a15a-e08d8e25f0af]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d0f7ec-9a90-440b-86fc-983b93d80d26]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:36 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee42121-d3d5-4c11-b06e-b4c63b7c7a40]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:13:36 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDGbZkdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:13:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23961633434663963', 'path': '/dev/sdj'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961633434663963', 'path': '/dev/sdj'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:13:37 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lazy-loading 'flavor' on Instance uuid fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:13:37 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:13:37 user nova-compute[72447]:   <source dev="/dev/sdj"/>
Jul 31 12:13:37 user nova-compute[72447]:   <target dev="sdc" bus="scsi"/>
Jul 31 12:13:37 user nova-compute[72447]:   <serial>dbb2afda-cd16-4052-8c8f-6b5014d4e5ef</serial>
Jul 31 12:13:37 user nova-compute[72447]:   <address type="drive" controller="0" unit="2"/>
Jul 31 12:13:37 user nova-compute[72447]: </disk>
Jul 31 12:13:37 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SugEDHps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:38 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:38 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:38 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cccd9f-2107-4889-bcd0-ec5e182149dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:13:38 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d46fd8-4838-41f5-894e-4812377b9e40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585] added
Jul 31 12:13:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[523b03d2-10e5-4eed-aa0d-bd4e6ce1f64e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98f1f0f-5892-4c90-a935-3ba64bbd69d2]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SugEDHps {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SugEDHps" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af3147e-897e-4128-a4ad-f5145fe0db25]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SugEDHps'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25fa4e1-4f53-4731-bff7-39b1fa444f0a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e30e3e-96dd-42ca-a70b-c661ff83c038]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f12bec-adb9-4f13-9a2f-08097d47062e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585, portal: 172.16.0.220,3260]
Jul 31 12:13:38 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585, portal: 172.16.0.220,3260] successful.
Jul 31 12:13:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] No BDM found with device name sda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] No VIF found with MAC fa:16:3e:d7:54:1c, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d352aa8a-2f8c-4356-88f6-eea0cb010a8f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f499edde-a8af-43e6-85a4-360f3505fb54]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d25ff38-bf27-432a-be1f-a7c189d33d4a]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SugEDHps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0ceed365-c9af-41f7-85c9-cdd5c1085b94 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.854s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG nova.objects.instance [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lazy-loading 'flavor' on Instance uuid b2cab306-7667-47cf-a689-75ad6d6b5dc3 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:39 user nova-compute[72447]: INFO nova.compute.manager [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Attaching volume 2ffe45e7-ec00-47cf-a529-8fd0d4680536 to /dev/vdb
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.utils [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3586e28e-43a6-477c-890d-d10e17209c3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[054a5cab-b64c-4695-a7f3-0a51294cfe4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7cfd15-aafd-46f6-af6d-a4610d4d66ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[812c38a6-05e7-4996-bb84-89cfae2b471b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:13:39 user nova-compute[72447]: INFO nova.compute.manager [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Detaching volume dbb2afda-cd16-4052-8c8f-6b5014d4e5ef
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:13:39 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[08106011-a232-4e7a-8a53-586aca9ee1cb]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.utils [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Updating existing volume attachment record: e33926b5-1397-4f9e-9f30-9084d43eede5 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:13:39 user nova-compute[72447]: INFO nova.virt.block_device [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Attempting to driver detach volume dbb2afda-cd16-4052-8c8f-6b5014d4e5ef from mountpoint /dev/sdc
Jul 31 12:13:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Attempting to detach device sdc from instance fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:13:39 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:13:39 user nova-compute[72447]:   <source dev="/dev/sdj"/>
Jul 31 12:13:39 user nova-compute[72447]:   <target dev="sdc" bus="scsi"/>
Jul 31 12:13:39 user nova-compute[72447]:   <serial>dbb2afda-cd16-4052-8c8f-6b5014d4e5ef</serial>
Jul 31 12:13:39 user nova-compute[72447]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 31 12:13:39 user nova-compute[72447]: </disk>
Jul 31 12:13:39 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:13:39 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Successfully detached device sdc from instance fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 from the persistent domain config.
Jul 31 12:13:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:13:39 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:13:39 user nova-compute[72447]:   <source dev="/dev/sdj"/>
Jul 31 12:13:39 user nova-compute[72447]:   <target dev="sdc" bus="scsi"/>
Jul 31 12:13:39 user nova-compute[72447]:   <serial>dbb2afda-cd16-4052-8c8f-6b5014d4e5ef</serial>
Jul 31 12:13:39 user nova-compute[72447]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 31 12:13:39 user nova-compute[72447]: </disk>
Jul 31 12:13:39 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23735633431366165', 'path': '/dev/sdk'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735633431366165', 'path': '/dev/sdk'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG nova.objects.instance [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lazy-loading 'flavor' on Instance uuid b8929e20-a1f2-4a9c-a0c8-e0241113f0af {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:13:39 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:13:39 user nova-compute[72447]:   <source dev="/dev/sdk"/>
Jul 31 12:13:39 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:13:39 user nova-compute[72447]:   <serial>7063fd1d-f0cb-42a8-bc90-69b8a6a14585</serial>
Jul 31 12:13:39 user nova-compute[72447]: </disk>
Jul 31 12:13:39 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690805619.752141, fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:13:39 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Successfully detached device sdc from instance fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 from the live domain config.
Jul 31 12:13:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDGbZkdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:39 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17452bf-ad2e-4e72-a2e9-8bd254cc3cab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77713fa-e20f-489a-9843-f594b890f71e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:39 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0670299a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef'): ({'sdj'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Removing single pathed devices sdj {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a039a4-3c86-4e5e-901f-83c717457cf8]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c672b0e-d793-4181-9ecc-7cb733305a25]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Flushing IO for device /dev/sdj {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32702c1-b440-4780-b1c2-3df2eddb1525]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.038s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ce9988-8523-4d30-8e3b-f0cdb67d0dc1]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] SCSI volumes sdj have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:13:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dfe6cf-51a6-4155-8b53-860c890672e6]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28f1b0f-c3f7-4886-b7ee-bd0630051cbe]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef, portal: 172.16.0.220,3260]
Jul 31 12:13:40 user nova-compute[72447]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef, portal: 172.16.0.220,3260] successful.
Jul 31 12:13:40 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb2afda-cd16-4052-8c8f-6b5014d4e5ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ee1720-bb4d-4067-bd01-fdd78c65984c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] <== disconnect_volume: return (363ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] No BDM found with device name hda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] No VIF found with MAC fa:16:3e:46:a9:05, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG nova.objects.instance [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lazy-loading 'flavor' on Instance uuid fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-76d51cb9-34e2-483a-8f8b-22dd0b4f871a tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.769s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-36839092-247c-48f1-b325-f419597ccbea tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.272s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:13:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:41 user nova-compute[72447]: INFO nova.compute.manager [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Terminating instance
Jul 31 12:13:41 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:13:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-a6e05a16-59b2-4af2-b991-c81ba65bccc0 req-c5c825a9-f87c-4471-aff8-066ae21f3bc6 service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Received event network-vif-unplugged-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a6e05a16-59b2-4af2-b991-c81ba65bccc0 req-c5c825a9-f87c-4471-aff8-066ae21f3bc6 service nova] Acquiring lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a6e05a16-59b2-4af2-b991-c81ba65bccc0 req-c5c825a9-f87c-4471-aff8-066ae21f3bc6 service nova] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a6e05a16-59b2-4af2-b991-c81ba65bccc0 req-c5c825a9-f87c-4471-aff8-066ae21f3bc6 service nova] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-a6e05a16-59b2-4af2-b991-c81ba65bccc0 req-c5c825a9-f87c-4471-aff8-066ae21f3bc6 service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] No waiting events found dispatching network-vif-unplugged-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-a6e05a16-59b2-4af2-b991-c81ba65bccc0 req-c5c825a9-f87c-4471-aff8-066ae21f3bc6 service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Received event network-vif-unplugged-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:13:42 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Instance destroyed successfully.
Jul 31 12:13:42 user nova-compute[72447]: DEBUG nova.objects.instance [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lazy-loading 'resources' on Instance uuid fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-619398897',display_name='tempest-AttachSCSIVolumeTestJSON-server-619398897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-619398897',id=6,image_ref='ab24c7c8-5d34-4187-bc9e-07898abeb3f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpZHa3zOPjXnIXSYwTWFNVB+fmhTSwWPFtgeIqHgj7lXEpJo4KIy6jvjaoTQwM3vHvZk9vTiac8VgyGN2wzP14xt3uz3TUzOnETwdJK+4ZhXI/JyG4MGgVnPjIASQ86ZA==',key_name='tempest-keypair-1549770097',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='334e410fe41c47169d8587fda6d752a2',ramdisk_id='',reservation_id='r-mj2xmazt',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ab24c7c8-5d34-4187-bc9e-07898abeb3f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1215701056',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1215701056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:11:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8be3e4842784437c91dedee143c34a96',uuid=fd2cf3ad-9409-44ea-9718-7fc6033bd0d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "address": "fa:16:3e:d7:54:1c", "network": {"id": "891f8f1e-f53f-46a2-82a6-daa0b2a69504", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-521582482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e410fe41c47169d8587fda6d752a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69205df-b8", "ovs_interfaceid": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Converting VIF {"id": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "address": "fa:16:3e:d7:54:1c", "network": {"id": "891f8f1e-f53f-46a2-82a6-daa0b2a69504", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-521582482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e410fe41c47169d8587fda6d752a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69205df-b8", "ovs_interfaceid": "c69205df-b8b2-4c1d-a7d5-aa4fff4b2476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=c69205df-b8b2-4c1d-a7d5-aa4fff4b2476,network=Network(891f8f1e-f53f-46a2-82a6-daa0b2a69504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69205df-b8') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG os_vif [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=c69205df-b8b2-4c1d-a7d5-aa4fff4b2476,network=Network(891f8f1e-f53f-46a2-82a6-daa0b2a69504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69205df-b8') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc69205df-b8, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:42 user nova-compute[72447]: INFO nova.compute.manager [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Detaching volume 7063fd1d-f0cb-42a8-bc90-69b8a6a14585
Jul 31 12:13:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:13:42 user nova-compute[72447]: INFO os_vif [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=c69205df-b8b2-4c1d-a7d5-aa4fff4b2476,network=Network(891f8f1e-f53f-46a2-82a6-daa0b2a69504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69205df-b8')
Jul 31 12:13:42 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Deleting instance files /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8_del
Jul 31 12:13:42 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Deletion of /opt/stack/data/nova/instances/fd2cf3ad-9409-44ea-9718-7fc6033bd0d8_del complete
Jul 31 12:13:42 user nova-compute[72447]: INFO nova.compute.manager [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Took 1.02 seconds to destroy the instance on the hypervisor.
Jul 31 12:13:42 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:13:42 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:13:42 user nova-compute[72447]: INFO nova.virt.block_device [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Attempting to driver detach volume 7063fd1d-f0cb-42a8-bc90-69b8a6a14585 from mountpoint /dev/vdb
Jul 31 12:13:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Attempting to detach device vdb from instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:13:43 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:13:43 user nova-compute[72447]:   <source dev="/dev/sdk"/>
Jul 31 12:13:43 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:13:43 user nova-compute[72447]:   <serial>7063fd1d-f0cb-42a8-bc90-69b8a6a14585</serial>
Jul 31 12:13:43 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 12:13:43 user nova-compute[72447]: </disk>
Jul 31 12:13:43 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:13:43 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Successfully detached device vdb from instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af from the persistent domain config.
Jul 31 12:13:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:13:43 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:13:43 user nova-compute[72447]:   <source dev="/dev/sdk"/>
Jul 31 12:13:43 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:13:43 user nova-compute[72447]:   <serial>7063fd1d-f0cb-42a8-bc90-69b8a6a14585</serial>
Jul 31 12:13:43 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 12:13:43 user nova-compute[72447]: </disk>
Jul 31 12:13:43 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690805623.5336955, b8929e20-a1f2-4a9c-a0c8-e0241113f0af => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:13:43 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Successfully detached device vdb from instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af from the live domain config.
Jul 31 12:13:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SugEDHps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:43 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e208bc6a-c046-44e1-a3ef-661f6109f457]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e8a996-ce3d-4516-afbd-79fc3d1b5615]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:43 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f067c526560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585'): ({'sdk'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Removing single pathed devices sdk {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3304bc-1274-46e5-a741-688fcfe18c47]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e4d2bc-c2bf-4c9a-b10e-9700e3e6340a]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Flushing IO for device /dev/sdk {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6c293b-1c4a-4445-9ca3-ce161ebe544a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.041s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c68adbd-f58c-4a0a-b405-f9506bf6e7e0]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] SCSI volumes sdk have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a12e0f2-bae5-4042-bde9-154d17bec3c1]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9946c7-a5fc-4c5b-80d9-dd689d7f04e2]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585, portal: 172.16.0.220,3260]
Jul 31 12:13:43 user nova-compute[72447]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585, portal: 172.16.0.220,3260] successful.
Jul 31 12:13:43 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7063fd1d-f0cb-42a8-bc90-69b8a6a14585 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a951d-2209-42d2-b25c-a25ec0c09d43]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] <== disconnect_volume: return (342ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:44 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Took 1.25 seconds to deallocate network for instance.
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-7959ede7-1e0c-4ad6-92d6-d18a4b240904 req-3ef4fc3f-c844-453b-8d3b-2daf51cc91bc service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Received event network-vif-deleted-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-6095dc0d-55fc-4705-817c-dee8b9b5f720 req-1bbc5c58-5e33-4005-a9b5-dfef8b36a81b service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Received event network-vif-plugged-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6095dc0d-55fc-4705-817c-dee8b9b5f720 req-1bbc5c58-5e33-4005-a9b5-dfef8b36a81b service nova] Acquiring lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6095dc0d-55fc-4705-817c-dee8b9b5f720 req-1bbc5c58-5e33-4005-a9b5-dfef8b36a81b service nova] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6095dc0d-55fc-4705-817c-dee8b9b5f720 req-1bbc5c58-5e33-4005-a9b5-dfef8b36a81b service nova] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-6095dc0d-55fc-4705-817c-dee8b9b5f720 req-1bbc5c58-5e33-4005-a9b5-dfef8b36a81b service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] No waiting events found dispatching network-vif-plugged-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:13:44 user nova-compute[72447]: WARNING nova.compute.manager [req-6095dc0d-55fc-4705-817c-dee8b9b5f720 req-1bbc5c58-5e33-4005-a9b5-dfef8b36a81b service nova] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Received unexpected event network-vif-plugged-c69205df-b8b2-4c1d-a7d5-aa4fff4b2476 for instance with vm_state deleted and task_state None.
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgwWCGcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '700d80d6-9248-4d6f-9010-c3904d8fec2c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a28358f8-4d88-4fc4-a56c-16df5d2b0793', 'serial': 'a28358f8-4d88-4fc4-a56c-16df5d2b0793'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwuZMPeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '700d80d6-9248-4d6f-9010-c3904d8fec2c', 'attached_at': '', 'detached_at': '', 'volume_id': '98d2481b-ed84-43c9-af4e-c98f04982110', 'serial'} {{(pid=72447) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgwWCGcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:44 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:44 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:44 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fc4730-1cbe-4426-9688-677f48ee17a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:13:44 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c58de04-c821-4125-b007-94a333467c9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793] added
Jul 31 12:13:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac6d099-1df5-44ef-b1a8-f331ca0bd6e4]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:44 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Deleted allocations for instance fd2cf3ad-9409-44ea-9718-7fc6033bd0d8
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2330b31-22d1-47fc-989a-56f6f7ea4b5a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgwWCGcS {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgwWCGcS" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8865e5-512a-4da6-8e15-a6dbfc9fe2e4]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QgwWCGcS'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac111b7-b900-4e07-aa97-a59a6f4baf14]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lazy-loading 'flavor' on Instance uuid b8929e20-a1f2-4a9c-a0c8-e0241113f0af {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f844cbc0-06b6-4c6b-92c0-59a3ccec496b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ce25709d-86ae-4b29-9ee5-197e15269ea9 tempest-AttachSCSIVolumeTestJSON-1215701056 tempest-AttachSCSIVolumeTestJSON-1215701056-project-member] Lock "fd2cf3ad-9409-44ea-9718-7fc6033bd0d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.995s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4f73f1bb-e685-4f84-b2d9-364061279eb1 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.209s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d87cd5-b78b-40fa-9e11-3e23b69cb114]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793, portal: 172.16.0.220,3260]
Jul 31 12:13:44 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793, portal: 172.16.0.220,3260] successful.
Jul 31 12:13:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updating instance_info_cache with network_info: [{"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05ce3c1-ff94-429d-b7ed-b4f31de0a7fd]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f290575-7de6-4b9f-b455-c9ee75e3400b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75c136f-deb4-425f-b110-1d8a0f20022f]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:13:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgwWCGcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "interface-b8929e20-a1f2-4a9c-a0c8-e0241113f0af-de27da5d-b9c5-449f-858a-2d27d62e2527" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "interface-b8929e20-a1f2-4a9c-a0c8-e0241113f0af-de27da5d-b9c5-449f-858a-2d27d62e2527" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lazy-loading 'flavor' on Instance uuid b8929e20-a1f2-4a9c-a0c8-e0241113f0af {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1947605890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1947605890',id=7,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn5YeitERNgZiavoklE86RU3W69tKvanqOuX1Z4JM4bRcMNOeZRTBb//da8RjvsuxuqMZXyuEd1IjLCPuMWJJvrbNo/sdXOTs0iSDWka1Ds3bPHY+Kbf22pgZ3qNjgNdg==',key_name='tempest-keypair-117256101',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9a05f78f7104db98fe0e537d3f22208',ramdisk_id='',reservation_id='r-7n456tj0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1246153700',owner_user_name='tempest-TaggedAttachmentsTest-1246153700-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d71c3e48f72842709366c6ad635fca49',uuid=b8929e20-a1f2-4a9c-a0c8-e0241113f0af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de27da5d-b9c5-449f-858a-2d27d62e2527", "address": "fa:16:3e:2c:a1:85", "network": {"id": "5d341115-50ea-47df-8221-00d1580b132a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2104785291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde27da5d-b9", "ovs_interfaceid": "de27da5d-b9c5-449f-858a-2d27d62e2527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converting VIF {"id": "de27da5d-b9c5-449f-858a-2d27d62e2527", "address": "fa:16:3e:2c:a1:85", "network": {"id": "5d341115-50ea-47df-8221-00d1580b132a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2104785291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde27da5d-b9", "ovs_interfaceid": "de27da5d-b9c5-449f-858a-2d27d62e2527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:85,bridge_name='br-int',has_traffic_filtering=True,id=de27da5d-b9c5-449f-858a-2d27d62e2527,network=Network(5d341115-50ea-47df-8221-00d1580b132a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde27da5d-b9') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2c:a1:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapde27da5d-b9"/></interface> {{(pid=72447) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2c:a1:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapde27da5d-b9"/></interface> {{(pid=72447) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Attempting to detach device tapde27da5d-b9 from instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] detach device xml: <interface type="ethernet">
Jul 31 12:13:45 user nova-compute[72447]:   <mac address="fa:16:3e:2c:a1:85"/>
Jul 31 12:13:45 user nova-compute[72447]:   <model type="virtio"/>
Jul 31 12:13:45 user nova-compute[72447]:   <mtu size="1442"/>
Jul 31 12:13:45 user nova-compute[72447]:   <target dev="tapde27da5d-b9"/>
Jul 31 12:13:45 user nova-compute[72447]: </interface>
Jul 31 12:13:45 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2c:a1:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapde27da5d-b9"/></interface> {{(pid=72447) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2c:a1:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapde27da5d-b9"/></interface>not found in domain: <domain type='kvm' id='7'>
Jul 31 12:13:45 user nova-compute[72447]:   <name>instance-00000007</name>
Jul 31 12:13:45 user nova-compute[72447]:   <uuid>b8929e20-a1f2-4a9c-a0c8-e0241113f0af</uuid>
Jul 31 12:13:45 user nova-compute[72447]:   <metadata>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:13:45 user nova-compute[72447]:   <nova:package version="0.0.0"/>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:name>tempest-device-tagging-server-1947605890</nova:name>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:creationTime>2023-07-31 12:13:26</nova:creationTime>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:flavor name="m1.tiny">
Jul 31 12:13:45 user nova-compute[72447]:     <nova:memory>512</nova:memory>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:disk>1</nova:disk>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:swap>0</nova:swap>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:vcpus>1</nova:vcpus>
Jul 31 12:13:45 user nova-compute[72447]:   </nova:flavor>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:owner>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:user uuid="d71c3e48f72842709366c6ad635fca49">tempest-TaggedAttachmentsTest-1246153700-project-member</nova:user>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:project uuid="f9a05f78f7104db98fe0e537d3f22208">tempest-TaggedAttachmentsTest-1246153700</nova:project>
Jul 31 12:13:45 user nova-compute[72447]:   </nova:owner>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:ports>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:port uuid="4607d653-6d85-46b9-b00e-39748d9afb78">
Jul 31 12:13:45 user nova-compute[72447]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:13:45 user nova-compute[72447]:     </nova:port>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:port uuid="de27da5d-b9c5-449f-858a-2d27d62e2527">
Jul 31 12:13:45 user nova-compute[72447]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Jul 31 12:13:45 user nova-compute[72447]:     </nova:port>
Jul 31 12:13:45 user nova-compute[72447]:   </nova:ports>
Jul 31 12:13:45 user nova-compute[72447]: </nova:instance>
Jul 31 12:13:45 user nova-compute[72447]:   </metadata>
Jul 31 12:13:45 user nova-compute[72447]:   <memory unit='KiB'>524288</memory>
Jul 31 12:13:45 user nova-compute[72447]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 31 12:13:45 user nova-compute[72447]:   <vcpu placement='static'>1</vcpu>
Jul 31 12:13:45 user nova-compute[72447]:   <resource>
Jul 31 12:13:45 user nova-compute[72447]:     <partition>/machine</partition>
Jul 31 12:13:45 user nova-compute[72447]:   </resource>
Jul 31 12:13:45 user nova-compute[72447]:   <sysinfo type='smbios'>
Jul 31 12:13:45 user nova-compute[72447]:     <system>
Jul 31 12:13:45 user nova-compute[72447]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 31 12:13:45 user nova-compute[72447]:       <entry name='product'>OpenStack Nova</entry>
Jul 31 12:13:45 user nova-compute[72447]:       <entry name='version'>0.0.0</entry>
Jul 31 12:13:45 user nova-compute[72447]:       <entry name='serial'>b8929e20-a1f2-4a9c-a0c8-e0241113f0af</entry>
Jul 31 12:13:45 user nova-compute[72447]:       <entry name='uuid'>b8929e20-a1f2-4a9c-a0c8-e0241113f0af</entry>
Jul 31 12:13:45 user nova-compute[72447]:       <entry name='family'>Virtual Machine</entry>
Jul 31 12:13:45 user nova-compute[72447]:     </system>
Jul 31 12:13:45 user nova-compute[72447]:   </sysinfo>
Jul 31 12:13:45 user nova-compute[72447]:   <os>
Jul 31 12:13:45 user nova-compute[72447]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 31 12:13:45 user nova-compute[72447]:     <boot dev='hd'/>
Jul 31 12:13:45 user nova-compute[72447]:     <smbios mode='sysinfo'/>
Jul 31 12:13:45 user nova-compute[72447]:   </os>
Jul 31 12:13:45 user nova-compute[72447]:   <features>
Jul 31 12:13:45 user nova-compute[72447]:     <acpi/>
Jul 31 12:13:45 user nova-compute[72447]:     <apic/>
Jul 31 12:13:45 user nova-compute[72447]:     <vmcoreinfo state='on'/>
Jul 31 12:13:45 user nova-compute[72447]:   </features>
Jul 31 12:13:45 user nova-compute[72447]:   <cpu mode='custom' match='exact' check='full'>
Jul 31 12:13:45 user nova-compute[72447]:     <model fallback='forbid'>Nehalem</model>
Jul 31 12:13:45 user nova-compute[72447]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 31 12:13:45 user nova-compute[72447]:     <feature policy='require' name='vme'/>
Jul 31 12:13:45 user nova-compute[72447]:     <feature policy='require' name='x2apic'/>
Jul 31 12:13:45 user nova-compute[72447]:     <feature policy='require' name='hypervisor'/>
Jul 31 12:13:45 user nova-compute[72447]:   </cpu>
Jul 31 12:13:45 user nova-compute[72447]:   <clock offset='utc'>
Jul 31 12:13:45 user nova-compute[72447]:     <timer name='pit' tickpolicy='delay'/>
Jul 31 12:13:45 user nova-compute[72447]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 31 12:13:45 user nova-compute[72447]:     <timer name='hpet' present='no'/>
Jul 31 12:13:45 user nova-compute[72447]:   </clock>
Jul 31 12:13:45 user nova-compute[72447]:   <on_poweroff>destroy</on_poweroff>
Jul 31 12:13:45 user nova-compute[72447]:   <on_reboot>restart</on_reboot>
Jul 31 12:13:45 user nova-compute[72447]:   <on_crash>destroy</on_crash>
Jul 31 12:13:45 user nova-compute[72447]:   <devices>
Jul 31 12:13:45 user nova-compute[72447]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 12:13:45 user nova-compute[72447]:     <disk type='file' device='disk'>
Jul 31 12:13:45 user nova-compute[72447]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 31 12:13:45 user nova-compute[72447]:       <source file='/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk' index='2'/>
Jul 31 12:13:45 user nova-compute[72447]:       <backingStore type='file' index='3'>
Jul 31 12:13:45 user nova-compute[72447]:         <format type='raw'/>
Jul 31 12:13:45 user nova-compute[72447]:         <source file='/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c'/>
Jul 31 12:13:45 user nova-compute[72447]:         <backingStore/>
Jul 31 12:13:45 user nova-compute[72447]:       </backingStore>
Jul 31 12:13:45 user nova-compute[72447]:       <target dev='vda' bus='virtio'/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='virtio-disk0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </disk>
Jul 31 12:13:45 user nova-compute[72447]:     <disk type='file' device='cdrom'>
Jul 31 12:13:45 user nova-compute[72447]:       <driver name='qemu' type='raw' cache='none'/>
Jul 31 12:13:45 user nova-compute[72447]:       <source file='/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk.config' index='1'/>
Jul 31 12:13:45 user nova-compute[72447]:       <backingStore/>
Jul 31 12:13:45 user nova-compute[72447]:       <target dev='hda' bus='ide'/>
Jul 31 12:13:45 user nova-compute[72447]:       <readonly/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='ide0-0-0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </disk>
Jul 31 12:13:45 user nova-compute[72447]:     <controller type='usb' index='0' model='none'>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='usb'/>
Jul 31 12:13:45 user nova-compute[72447]:     </controller>
Jul 31 12:13:45 user nova-compute[72447]:     <controller type='pci' index='0' model='pci-root'>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='pci.0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </controller>
Jul 31 12:13:45 user nova-compute[72447]:     <controller type='ide' index='0'>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='ide'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 31 12:13:45 user nova-compute[72447]:     </controller>
Jul 31 12:13:45 user nova-compute[72447]:     <interface type='ethernet'>
Jul 31 12:13:45 user nova-compute[72447]:       <mac address='fa:16:3e:46:a9:05'/>
Jul 31 12:13:45 user nova-compute[72447]:       <target dev='tap4607d653-6d'/>
Jul 31 12:13:45 user nova-compute[72447]:       <model type='virtio'/>
Jul 31 12:13:45 user nova-compute[72447]:       <mtu size='1442'/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='net0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </interface>
Jul 31 12:13:45 user nova-compute[72447]:     <interface type='ethernet'>
Jul 31 12:13:45 user nova-compute[72447]:       <mac address='fa:16:3e:2c:a1:85'/>
Jul 31 12:13:45 user nova-compute[72447]:       <target dev='tapde27da5d-b9'/>
Jul 31 12:13:45 user nova-compute[72447]:       <model type='virtio'/>
Jul 31 12:13:45 user nova-compute[72447]:       <mtu size='1442'/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='net1'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </interface>
Jul 31 12:13:45 user nova-compute[72447]:     <serial type='pty'>
Jul 31 12:13:45 user nova-compute[72447]:       <source path='/dev/pts/6'/>
Jul 31 12:13:45 user nova-compute[72447]:       <log file='/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/console.log' append='off'/>
Jul 31 12:13:45 user nova-compute[72447]:       <target type='isa-serial' port='0'>
Jul 31 12:13:45 user nova-compute[72447]:         <model name='isa-serial'/>
Jul 31 12:13:45 user nova-compute[72447]:       </target>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='serial0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </serial>
Jul 31 12:13:45 user nova-compute[72447]:     <console type='pty' tty='/dev/pts/6'>
Jul 31 12:13:45 user nova-compute[72447]:       <source path='/dev/pts/6'/>
Jul 31 12:13:45 user nova-compute[72447]:       <log file='/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/console.log' append='off'/>
Jul 31 12:13:45 user nova-compute[72447]:       <target type='serial' port='0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='serial0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </console>
Jul 31 12:13:45 user nova-compute[72447]:     <input type='mouse' bus='ps2'>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='input0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </input>
Jul 31 12:13:45 user nova-compute[72447]:     <input type='keyboard' bus='ps2'>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='input1'/>
Jul 31 12:13:45 user nova-compute[72447]:     </input>
Jul 31 12:13:45 user nova-compute[72447]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Jul 31 12:13:45 user nova-compute[72447]:       <listen type='address' address='0.0.0.0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </graphics>
Jul 31 12:13:45 user nova-compute[72447]:     <audio id='1' type='none'/>
Jul 31 12:13:45 user nova-compute[72447]:     <video>
Jul 31 12:13:45 user nova-compute[72447]:       <model type='virtio' heads='1' primary='yes'/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='video0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </video>
Jul 31 12:13:45 user nova-compute[72447]:     <memballoon model='virtio'>
Jul 31 12:13:45 user nova-compute[72447]:       <stats period='10'/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='balloon0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </memballoon>
Jul 31 12:13:45 user nova-compute[72447]:     <rng model='virtio'>
Jul 31 12:13:45 user nova-compute[72447]:       <backend model='random'>/dev/urandom</backend>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='rng0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </rng>
Jul 31 12:13:45 user nova-compute[72447]:   </devices>
Jul 31 12:13:45 user nova-compute[72447]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 31 12:13:45 user nova-compute[72447]:     <label>libvirt-b8929e20-a1f2-4a9c-a0c8-e0241113f0af</label>
Jul 31 12:13:45 user nova-compute[72447]:     <imagelabel>libvirt-b8929e20-a1f2-4a9c-a0c8-e0241113f0af</imagelabel>
Jul 31 12:13:45 user nova-compute[72447]:   </seclabel>
Jul 31 12:13:45 user nova-compute[72447]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 31 12:13:45 user nova-compute[72447]:     <label>+64055:+108</label>
Jul 31 12:13:45 user nova-compute[72447]:     <imagelabel>+64055:+108</imagelabel>
Jul 31 12:13:45 user nova-compute[72447]:   </seclabel>
Jul 31 12:13:45 user nova-compute[72447]: </domain>
Jul 31 12:13:45 user nova-compute[72447]:  {{(pid=72447) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 31 12:13:45 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Successfully detached device tapde27da5d-b9 from instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af from the persistent domain config.
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] (1/8): Attempting to detach device tapde27da5d-b9 with device alias net1 from instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] detach device xml: <interface type="ethernet">
Jul 31 12:13:45 user nova-compute[72447]:   <mac address="fa:16:3e:2c:a1:85"/>
Jul 31 12:13:45 user nova-compute[72447]:   <model type="virtio"/>
Jul 31 12:13:45 user nova-compute[72447]:   <mtu size="1442"/>
Jul 31 12:13:45 user nova-compute[72447]:   <target dev="tapde27da5d-b9"/>
Jul 31 12:13:45 user nova-compute[72447]: </interface>
Jul 31 12:13:45 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690805625.5182717, b8929e20-a1f2-4a9c-a0c8-e0241113f0af => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Start waiting for the detach event from libvirt for device tapde27da5d-b9 with device alias net1 for instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2c:a1:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapde27da5d-b9"/></interface> {{(pid=72447) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2c:a1:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapde27da5d-b9"/></interface>not found in domain: <domain type='kvm' id='7'>
Jul 31 12:13:45 user nova-compute[72447]:   <name>instance-00000007</name>
Jul 31 12:13:45 user nova-compute[72447]:   <uuid>b8929e20-a1f2-4a9c-a0c8-e0241113f0af</uuid>
Jul 31 12:13:45 user nova-compute[72447]:   <metadata>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:13:45 user nova-compute[72447]:   <nova:package version="0.0.0"/>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:name>tempest-device-tagging-server-1947605890</nova:name>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:creationTime>2023-07-31 12:13:26</nova:creationTime>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:flavor name="m1.tiny">
Jul 31 12:13:45 user nova-compute[72447]:     <nova:memory>512</nova:memory>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:disk>1</nova:disk>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:swap>0</nova:swap>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:vcpus>1</nova:vcpus>
Jul 31 12:13:45 user nova-compute[72447]:   </nova:flavor>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:owner>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:user uuid="d71c3e48f72842709366c6ad635fca49">tempest-TaggedAttachmentsTest-1246153700-project-member</nova:user>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:project uuid="f9a05f78f7104db98fe0e537d3f22208">tempest-TaggedAttachmentsTest-1246153700</nova:project>
Jul 31 12:13:45 user nova-compute[72447]:   </nova:owner>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:ports>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:port uuid="4607d653-6d85-46b9-b00e-39748d9afb78">
Jul 31 12:13:45 user nova-compute[72447]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:13:45 user nova-compute[72447]:     </nova:port>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:port uuid="de27da5d-b9c5-449f-858a-2d27d62e2527">
Jul 31 12:13:45 user nova-compute[72447]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Jul 31 12:13:45 user nova-compute[72447]:     </nova:port>
Jul 31 12:13:45 user nova-compute[72447]:   </nova:ports>
Jul 31 12:13:45 user nova-compute[72447]: </nova:instance>
Jul 31 12:13:45 user nova-compute[72447]:   </metadata>
Jul 31 12:13:45 user nova-compute[72447]:   <memory unit='KiB'>524288</memory>
Jul 31 12:13:45 user nova-compute[72447]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 31 12:13:45 user nova-compute[72447]:   <vcpu placement='static'>1</vcpu>
Jul 31 12:13:45 user nova-compute[72447]:   <resource>
Jul 31 12:13:45 user nova-compute[72447]:     <partition>/machine</partition>
Jul 31 12:13:45 user nova-compute[72447]:   </resource>
Jul 31 12:13:45 user nova-compute[72447]:   <sysinfo type='smbios'>
Jul 31 12:13:45 user nova-compute[72447]:     <system>
Jul 31 12:13:45 user nova-compute[72447]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 31 12:13:45 user nova-compute[72447]:       <entry name='product'>OpenStack Nova</entry>
Jul 31 12:13:45 user nova-compute[72447]:       <entry name='version'>0.0.0</entry>
Jul 31 12:13:45 user nova-compute[72447]:       <entry name='serial'>b8929e20-a1f2-4a9c-a0c8-e0241113f0af</entry>
Jul 31 12:13:45 user nova-compute[72447]:       <entry name='uuid'>b8929e20-a1f2-4a9c-a0c8-e0241113f0af</entry>
Jul 31 12:13:45 user nova-compute[72447]:       <entry name='family'>Virtual Machine</entry>
Jul 31 12:13:45 user nova-compute[72447]:     </system>
Jul 31 12:13:45 user nova-compute[72447]:   </sysinfo>
Jul 31 12:13:45 user nova-compute[72447]:   <os>
Jul 31 12:13:45 user nova-compute[72447]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 31 12:13:45 user nova-compute[72447]:     <boot dev='hd'/>
Jul 31 12:13:45 user nova-compute[72447]:     <smbios mode='sysinfo'/>
Jul 31 12:13:45 user nova-compute[72447]:   </os>
Jul 31 12:13:45 user nova-compute[72447]:   <features>
Jul 31 12:13:45 user nova-compute[72447]:     <acpi/>
Jul 31 12:13:45 user nova-compute[72447]:     <apic/>
Jul 31 12:13:45 user nova-compute[72447]:     <vmcoreinfo state='on'/>
Jul 31 12:13:45 user nova-compute[72447]:   </features>
Jul 31 12:13:45 user nova-compute[72447]:   <cpu mode='custom' match='exact' check='full'>
Jul 31 12:13:45 user nova-compute[72447]:     <model fallback='forbid'>Nehalem</model>
Jul 31 12:13:45 user nova-compute[72447]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 31 12:13:45 user nova-compute[72447]:     <feature policy='require' name='vme'/>
Jul 31 12:13:45 user nova-compute[72447]:     <feature policy='require' name='x2apic'/>
Jul 31 12:13:45 user nova-compute[72447]:     <feature policy='require' name='hypervisor'/>
Jul 31 12:13:45 user nova-compute[72447]:   </cpu>
Jul 31 12:13:45 user nova-compute[72447]:   <clock offset='utc'>
Jul 31 12:13:45 user nova-compute[72447]:     <timer name='pit' tickpolicy='delay'/>
Jul 31 12:13:45 user nova-compute[72447]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 31 12:13:45 user nova-compute[72447]:     <timer name='hpet' present='no'/>
Jul 31 12:13:45 user nova-compute[72447]:   </clock>
Jul 31 12:13:45 user nova-compute[72447]:   <on_poweroff>destroy</on_poweroff>
Jul 31 12:13:45 user nova-compute[72447]:   <on_reboot>restart</on_reboot>
Jul 31 12:13:45 user nova-compute[72447]:   <on_crash>destroy</on_crash>
Jul 31 12:13:45 user nova-compute[72447]:   <devices>
Jul 31 12:13:45 user nova-compute[72447]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 12:13:45 user nova-compute[72447]:     <disk type='file' device='disk'>
Jul 31 12:13:45 user nova-compute[72447]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 31 12:13:45 user nova-compute[72447]:       <source file='/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk' index='2'/>
Jul 31 12:13:45 user nova-compute[72447]:       <backingStore type='file' index='3'>
Jul 31 12:13:45 user nova-compute[72447]:         <format type='raw'/>
Jul 31 12:13:45 user nova-compute[72447]:         <source file='/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c'/>
Jul 31 12:13:45 user nova-compute[72447]:         <backingStore/>
Jul 31 12:13:45 user nova-compute[72447]:       </backingStore>
Jul 31 12:13:45 user nova-compute[72447]:       <target dev='vda' bus='virtio'/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='virtio-disk0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </disk>
Jul 31 12:13:45 user nova-compute[72447]:     <disk type='file' device='cdrom'>
Jul 31 12:13:45 user nova-compute[72447]:       <driver name='qemu' type='raw' cache='none'/>
Jul 31 12:13:45 user nova-compute[72447]:       <source file='/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk.config' index='1'/>
Jul 31 12:13:45 user nova-compute[72447]:       <backingStore/>
Jul 31 12:13:45 user nova-compute[72447]:       <target dev='hda' bus='ide'/>
Jul 31 12:13:45 user nova-compute[72447]:       <readonly/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='ide0-0-0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </disk>
Jul 31 12:13:45 user nova-compute[72447]:     <controller type='usb' index='0' model='none'>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='usb'/>
Jul 31 12:13:45 user nova-compute[72447]:     </controller>
Jul 31 12:13:45 user nova-compute[72447]:     <controller type='pci' index='0' model='pci-root'>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='pci.0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </controller>
Jul 31 12:13:45 user nova-compute[72447]:     <controller type='ide' index='0'>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='ide'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 31 12:13:45 user nova-compute[72447]:     </controller>
Jul 31 12:13:45 user nova-compute[72447]:     <interface type='ethernet'>
Jul 31 12:13:45 user nova-compute[72447]:       <mac address='fa:16:3e:46:a9:05'/>
Jul 31 12:13:45 user nova-compute[72447]:       <target dev='tap4607d653-6d'/>
Jul 31 12:13:45 user nova-compute[72447]:       <model type='virtio'/>
Jul 31 12:13:45 user nova-compute[72447]:       <mtu size='1442'/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='net0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </interface>
Jul 31 12:13:45 user nova-compute[72447]:     <serial type='pty'>
Jul 31 12:13:45 user nova-compute[72447]:       <source path='/dev/pts/6'/>
Jul 31 12:13:45 user nova-compute[72447]:       <log file='/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/console.log' append='off'/>
Jul 31 12:13:45 user nova-compute[72447]:       <target type='isa-serial' port='0'>
Jul 31 12:13:45 user nova-compute[72447]:         <model name='isa-serial'/>
Jul 31 12:13:45 user nova-compute[72447]:       </target>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='serial0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </serial>
Jul 31 12:13:45 user nova-compute[72447]:     <console type='pty' tty='/dev/pts/6'>
Jul 31 12:13:45 user nova-compute[72447]:       <source path='/dev/pts/6'/>
Jul 31 12:13:45 user nova-compute[72447]:       <log file='/opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/console.log' append='off'/>
Jul 31 12:13:45 user nova-compute[72447]:       <target type='serial' port='0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='serial0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </console>
Jul 31 12:13:45 user nova-compute[72447]:     <input type='mouse' bus='ps2'>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='input0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </input>
Jul 31 12:13:45 user nova-compute[72447]:     <input type='keyboard' bus='ps2'>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='input1'/>
Jul 31 12:13:45 user nova-compute[72447]:     </input>
Jul 31 12:13:45 user nova-compute[72447]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Jul 31 12:13:45 user nova-compute[72447]:       <listen type='address' address='0.0.0.0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </graphics>
Jul 31 12:13:45 user nova-compute[72447]:     <audio id='1' type='none'/>
Jul 31 12:13:45 user nova-compute[72447]:     <video>
Jul 31 12:13:45 user nova-compute[72447]:       <model type='virtio' heads='1' primary='yes'/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='video0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </video>
Jul 31 12:13:45 user nova-compute[72447]:     <memballoon model='virtio'>
Jul 31 12:13:45 user nova-compute[72447]:       <stats period='10'/>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='balloon0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </memballoon>
Jul 31 12:13:45 user nova-compute[72447]:     <rng model='virtio'>
Jul 31 12:13:45 user nova-compute[72447]:       <backend model='random'>/dev/urandom</backend>
Jul 31 12:13:45 user nova-compute[72447]:       <alias name='rng0'/>
Jul 31 12:13:45 user nova-compute[72447]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 31 12:13:45 user nova-compute[72447]:     </rng>
Jul 31 12:13:45 user nova-compute[72447]:   </devices>
Jul 31 12:13:45 user nova-compute[72447]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 31 12:13:45 user nova-compute[72447]:     <label>libvirt-b8929e20-a1f2-4a9c-a0c8-e0241113f0af</label>
Jul 31 12:13:45 user nova-compute[72447]:     <imagelabel>libvirt-b8929e20-a1f2-4a9c-a0c8-e0241113f0af</imagelabel>
Jul 31 12:13:45 user nova-compute[72447]:   </seclabel>
Jul 31 12:13:45 user nova-compute[72447]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 31 12:13:45 user nova-compute[72447]:     <label>+64055:+108</label>
Jul 31 12:13:45 user nova-compute[72447]:     <imagelabel>+64055:+108</imagelabel>
Jul 31 12:13:45 user nova-compute[72447]:   </seclabel>
Jul 31 12:13:45 user nova-compute[72447]: </domain>
Jul 31 12:13:45 user nova-compute[72447]:  {{(pid=72447) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 31 12:13:45 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Successfully detached device tapde27da5d-b9 from instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af from the live domain config.
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1947605890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1947605890',id=7,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn5YeitERNgZiavoklE86RU3W69tKvanqOuX1Z4JM4bRcMNOeZRTBb//da8RjvsuxuqMZXyuEd1IjLCPuMWJJvrbNo/sdXOTs0iSDWka1Ds3bPHY+Kbf22pgZ3qNjgNdg==',key_name='tempest-keypair-117256101',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9a05f78f7104db98fe0e537d3f22208',ramdisk_id='',reservation_id='r-7n456tj0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1246153700',owner_user_name='tempest-TaggedAttachmentsTest-1246153700-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d71c3e48f72842709366c6ad635fca49',uuid=b8929e20-a1f2-4a9c-a0c8-e0241113f0af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de27da5d-b9c5-449f-858a-2d27d62e2527", "address": "fa:16:3e:2c:a1:85", "network": {"id": "5d341115-50ea-47df-8221-00d1580b132a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2104785291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde27da5d-b9", "ovs_interfaceid": "de27da5d-b9c5-449f-858a-2d27d62e2527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converting VIF {"id": "de27da5d-b9c5-449f-858a-2d27d62e2527", "address": "fa:16:3e:2c:a1:85", "network": {"id": "5d341115-50ea-47df-8221-00d1580b132a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2104785291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde27da5d-b9", "ovs_interfaceid": "de27da5d-b9c5-449f-858a-2d27d62e2527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:85,bridge_name='br-int',has_traffic_filtering=True,id=de27da5d-b9c5-449f-858a-2d27d62e2527,network=Network(5d341115-50ea-47df-8221-00d1580b132a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde27da5d-b9') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG os_vif [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:85,bridge_name='br-int',has_traffic_filtering=True,id=de27da5d-b9c5-449f-858a-2d27d62e2527,network=Network(5d341115-50ea-47df-8221-00d1580b132a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde27da5d-b9') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde27da5d-b9, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:45 user nova-compute[72447]: INFO os_vif [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:a1:85,bridge_name='br-int',has_traffic_filtering=True,id=de27da5d-b9c5-449f-858a-2d27d62e2527,network=Network(5d341115-50ea-47df-8221-00d1580b132a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde27da5d-b9')
Jul 31 12:13:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:13:45 user nova-compute[72447]:   <nova:package version="0.0.0"/>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:name>tempest-device-tagging-server-1947605890</nova:name>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:creationTime>2023-07-31 12:13:45</nova:creationTime>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:flavor name="m1.tiny">
Jul 31 12:13:45 user nova-compute[72447]:     <nova:memory>512</nova:memory>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:disk>1</nova:disk>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:swap>0</nova:swap>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:vcpus>1</nova:vcpus>
Jul 31 12:13:45 user nova-compute[72447]:   </nova:flavor>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:owner>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:user uuid="d71c3e48f72842709366c6ad635fca49">tempest-TaggedAttachmentsTest-1246153700-project-member</nova:user>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:project uuid="f9a05f78f7104db98fe0e537d3f22208">tempest-TaggedAttachmentsTest-1246153700</nova:project>
Jul 31 12:13:45 user nova-compute[72447]:   </nova:owner>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:13:45 user nova-compute[72447]:   <nova:ports>
Jul 31 12:13:45 user nova-compute[72447]:     <nova:port uuid="4607d653-6d85-46b9-b00e-39748d9afb78">
Jul 31 12:13:45 user nova-compute[72447]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:13:45 user nova-compute[72447]:     </nova:port>
Jul 31 12:13:45 user nova-compute[72447]:   </nova:ports>
Jul 31 12:13:45 user nova-compute[72447]: </nova:instance>
Jul 31 12:13:45 user nova-compute[72447]:  {{(pid=72447) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 31 12:13:45 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:13:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23764303636373531', 'path': '/dev/sdj'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764303636373531', 'path': '/dev/sdj'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:13:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Lazy-loading 'flavor' on Instance uuid 700d80d6-9248-4d6f-9010-c3904d8fec2c {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dc8d819-155f-457d-a4b7-057d847a6dd2 req-f271eccd-b06b-49ea-aed7-f2a8064d66a3 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-vif-unplugged-de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dc8d819-155f-457d-a4b7-057d847a6dd2 req-f271eccd-b06b-49ea-aed7-f2a8064d66a3 service nova] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dc8d819-155f-457d-a4b7-057d847a6dd2 req-f271eccd-b06b-49ea-aed7-f2a8064d66a3 service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dc8d819-155f-457d-a4b7-057d847a6dd2 req-f271eccd-b06b-49ea-aed7-f2a8064d66a3 service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dc8d819-155f-457d-a4b7-057d847a6dd2 req-f271eccd-b06b-49ea-aed7-f2a8064d66a3 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] No waiting events found dispatching network-vif-unplugged-de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:13:46 user nova-compute[72447]: WARNING nova.compute.manager [req-5dc8d819-155f-457d-a4b7-057d847a6dd2 req-f271eccd-b06b-49ea-aed7-f2a8064d66a3 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received unexpected event network-vif-unplugged-de27da5d-b9c5-449f-858a-2d27d62e2527 for instance with vm_state active and task_state None.
Jul 31 12:13:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] COPY block job progress, current cursor: 3145728 final cursor: 1073741824 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:13:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquired lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] COPY block job progress, current cursor: 83886080 final cursor: 1073741824 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:13:47 user nova-compute[72447]: INFO nova.network.neutron [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Port de27da5d-b9c5-449f-858a-2d27d62e2527 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 31 12:13:47 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Updating instance_info_cache with network_info: [{"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Releasing lock "refresh_cache-b8929e20-a1f2-4a9c-a0c8-e0241113f0af" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3832a6ad-3824-4403-9715-37de6e45d5ef tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "interface-b8929e20-a1f2-4a9c-a0c8-e0241113f0af-de27da5d-b9c5-449f-858a-2d27d62e2527" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.381s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] COPY block job progress, current cursor: 209715200 final cursor: 1073741824 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Acquiring lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Acquiring lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:48 user nova-compute[72447]: INFO nova.compute.manager [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Terminating instance
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] COPY block job progress, current cursor: 308281344 final cursor: 1073741824 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-27fe97e8-fce3-40f3-bc7d-c800e3d8b41c req-9a807f01-3db5-4af7-8eda-f82e75586a43 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-vif-plugged-de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-27fe97e8-fce3-40f3-bc7d-c800e3d8b41c req-9a807f01-3db5-4af7-8eda-f82e75586a43 service nova] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-27fe97e8-fce3-40f3-bc7d-c800e3d8b41c req-9a807f01-3db5-4af7-8eda-f82e75586a43 service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-27fe97e8-fce3-40f3-bc7d-c800e3d8b41c req-9a807f01-3db5-4af7-8eda-f82e75586a43 service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-27fe97e8-fce3-40f3-bc7d-c800e3d8b41c req-9a807f01-3db5-4af7-8eda-f82e75586a43 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] No waiting events found dispatching network-vif-plugged-de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:13:48 user nova-compute[72447]: WARNING nova.compute.manager [req-27fe97e8-fce3-40f3-bc7d-c800e3d8b41c req-9a807f01-3db5-4af7-8eda-f82e75586a43 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received unexpected event network-vif-plugged-de27da5d-b9c5-449f-858a-2d27d62e2527 for instance with vm_state active and task_state None.
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-27fe97e8-fce3-40f3-bc7d-c800e3d8b41c req-9a807f01-3db5-4af7-8eda-f82e75586a43 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-vif-deleted-de27da5d-b9c5-449f-858a-2d27d62e2527 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-0dd14e74-0ad7-4b37-98a8-9d0d14c8c6dc req-6eaa0c68-875c-4962-884d-d1bd6e4f256b service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Received event network-vif-unplugged-56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0dd14e74-0ad7-4b37-98a8-9d0d14c8c6dc req-6eaa0c68-875c-4962-884d-d1bd6e4f256b service nova] Acquiring lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0dd14e74-0ad7-4b37-98a8-9d0d14c8c6dc req-6eaa0c68-875c-4962-884d-d1bd6e4f256b service nova] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0dd14e74-0ad7-4b37-98a8-9d0d14c8c6dc req-6eaa0c68-875c-4962-884d-d1bd6e4f256b service nova] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-0dd14e74-0ad7-4b37-98a8-9d0d14c8c6dc req-6eaa0c68-875c-4962-884d-d1bd6e4f256b service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] No waiting events found dispatching network-vif-unplugged-56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-0dd14e74-0ad7-4b37-98a8-9d0d14c8c6dc req-6eaa0c68-875c-4962-884d-d1bd6e4f256b service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Received event network-vif-unplugged-56b68bf9-56ca-4ad8-831c-798ae286683a for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] COPY block job progress, current cursor: 435159040 final cursor: 1073741824 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Instance destroyed successfully.
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lazy-loading 'resources' on Instance uuid 5b461cf8-5cb4-4dff-9bba-20930ec4ee84 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1771091047',display_name='tempest-VolumesActionsTest-instance-1771091047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1771091047',id=10,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e4e746fdc9b4a949985b20a9bf6c32a',ramdisk_id='',reservation_id='r-ojrtj5kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-657810840',owner_user_name='tempest-VolumesActionsTest-657810840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:11:58Z,user_data=None,user_id='2901cf34f3434675865d9fccd57b8f20',uuid=5b461cf8-5cb4-4dff-9bba-20930ec4ee84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56b68bf9-56ca-4ad8-831c-798ae286683a", "address": "fa:16:3e:d2:d0:b9", "network": {"id": "ef976ce1-87c7-4a27-83f0-cd3d764bdb86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464636439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e4e746fdc9b4a949985b20a9bf6c32a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b68bf9-56", "ovs_interfaceid": "56b68bf9-56ca-4ad8-831c-798ae286683a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Converting VIF {"id": "56b68bf9-56ca-4ad8-831c-798ae286683a", "address": "fa:16:3e:d2:d0:b9", "network": {"id": "ef976ce1-87c7-4a27-83f0-cd3d764bdb86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464636439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e4e746fdc9b4a949985b20a9bf6c32a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b68bf9-56", "ovs_interfaceid": "56b68bf9-56ca-4ad8-831c-798ae286683a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:b9,bridge_name='br-int',has_traffic_filtering=True,id=56b68bf9-56ca-4ad8-831c-798ae286683a,network=Network(ef976ce1-87c7-4a27-83f0-cd3d764bdb86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b68bf9-56') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG os_vif [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:b9,bridge_name='br-int',has_traffic_filtering=True,id=56b68bf9-56ca-4ad8-831c-798ae286683a,network=Network(ef976ce1-87c7-4a27-83f0-cd3d764bdb86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b68bf9-56') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56b68bf9-56, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:13:48 user nova-compute[72447]: INFO os_vif [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d0:b9,bridge_name='br-int',has_traffic_filtering=True,id=56b68bf9-56ca-4ad8-831c-798ae286683a,network=Network(ef976ce1-87c7-4a27-83f0-cd3d764bdb86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b68bf9-56')
Jul 31 12:13:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Deleting instance files /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84_del
Jul 31 12:13:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Deletion of /opt/stack/data/nova/instances/5b461cf8-5cb4-4dff-9bba-20930ec4ee84_del complete
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:49 user nova-compute[72447]: INFO nova.compute.manager [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] COPY block job progress, current cursor: 608174080 final cursor: 1073741824 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] COPY block job progress, current cursor: 758120448 final cursor: 1073741824 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:49 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Took 0.74 seconds to deallocate network for instance.
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:13:49 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '5b461cf8-5cb4-4dff-9bba-20930ec4ee84' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '5b461cf8-5cb4-4dff-9bba-20930ec4ee84' (instance-0000000a)
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] COPY block job progress, current cursor: 926941184 final cursor: 1073741824 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-6f0e1d1d-4ed9-4975-b39b-82dbdeed3c1a req-16613bb9-7ab3-4458-809f-13dd9778e88f service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Received event network-vif-deleted-56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.630s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-d2fe786a-7155-40bc-8c97-e1f11bc3d166 req-48d23248-30de-4a5c-afc2-512af3e624d1 service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Received event network-vif-plugged-56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d2fe786a-7155-40bc-8c97-e1f11bc3d166 req-48d23248-30de-4a5c-afc2-512af3e624d1 service nova] Acquiring lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d2fe786a-7155-40bc-8c97-e1f11bc3d166 req-48d23248-30de-4a5c-afc2-512af3e624d1 service nova] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d2fe786a-7155-40bc-8c97-e1f11bc3d166 req-48d23248-30de-4a5c-afc2-512af3e624d1 service nova] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-d2fe786a-7155-40bc-8c97-e1f11bc3d166 req-48d23248-30de-4a5c-afc2-512af3e624d1 service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] No waiting events found dispatching network-vif-plugged-56b68bf9-56ca-4ad8-831c-798ae286683a {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:13:50 user nova-compute[72447]: WARNING nova.compute.manager [req-d2fe786a-7155-40bc-8c97-e1f11bc3d166 req-48d23248-30de-4a5c-afc2-512af3e624d1 service nova] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Received unexpected event network-vif-plugged-56b68bf9-56ca-4ad8-831c-798ae286683a for instance with vm_state deleted and task_state None.
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:50 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Deleted allocations for instance 5b461cf8-5cb4-4dff-9bba-20930ec4ee84
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-41ebe7cc-cf4b-44e9-b868-d49c5fd6eb1b tempest-VolumesActionsTest-657810840 tempest-VolumesActionsTest-657810840-project-member] Lock "5b461cf8-5cb4-4dff-9bba-20930ec4ee84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.761s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] COPY block job progress, current cursor: 1029701632 final cursor: 1073741824 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:13:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:13:51 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:13:51 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=6725MB free_disk=25.467060089111328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwuZMPeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:51 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance ba0c6dba-0035-4196-a05f-9335436fac86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 700d80d6-9248-4d6f-9010-c3904d8fec2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b2cab306-7667-47cf-a689-75ad6d6b5dc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 52bef016-9676-446b-9a57-a43658e85e3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 8ddee7bd-86de-4bac-84c4-a8813ad9e985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 10919978-d29f-42b7-b091-309d7202b6ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2332b94a-36ab-4fb4-a376-63d58611c577]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2f88e8-b721-41da-a8e3-fcb0c567dcfc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 (non-flash)
Jul 31 12:13:51 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0670112b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110'): ({'sdi'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Removing single pathed devices sdi {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dc5de0-b6c6-43bf-8c23-5f7fb47f794b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b429a91-342a-4f5a-9286-5713528dd59a]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Flushing IO for device /dev/sdi {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c56134c-f33d-4de6-af2d-c88fa5719bc1]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.033s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb5f642-49be-4855-a977-5b2e01ecc22d]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] SCSI volumes sdi have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.092s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4334ed43-ace0-4e87-8fcd-c67c52ea848d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e8e3a2-bd01-4204-b490-3520b0a9f5ea]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110, portal: 172.16.0.220,3260]
Jul 31 12:13:52 user nova-compute[72447]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110, portal: 172.16.0.220,3260] successful.
Jul 31 12:13:52 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eeac5ce-a0f7-46b6-8840-7dd00bef4542]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] <== disconnect_volume: return (407ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgwWCGcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '700d80d6-9248-4d6f-9010-c3904d8fec2c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a28358f8-4d88-4fc4-a56c-16df5d2b0793', 'serial'} {{(pid=72447) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] swap_volume: removing Cinder connection for volume 98d2481b-ed84-43c9-af4e-c98f04982110 {{(pid=72447) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] swap_volume: Updating volume 98d2481b-ed84-43c9-af4e-c98f04982110 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "QgwWCGcS", "auth_password": "ZrJhYPGeU4ityj", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "a28358f8-4d88-4fc4-a56c-16df5d2b0793"}, "status": "reserved", "instance": "700d80d6-9248-4d6f-9010-c3904d8fec2c", "attached_at": "", "detached_at": "", "volume_id": "a28358f8-4d88-4fc4-a56c-16df5d2b0793", "serial": "a28358f8-4d88-4fc4-a56c-16df5d2b0793"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a28358f8-4d88-4fc4-a56c-16df5d2b0793', 'no_device': None, 'attachment_id': 'ab042e50-bb9a-4a7e-b1f3-fad1cc3f41f8'} {{(pid=72447) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 31 12:13:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-52eab1a8-f013-4295-8ce3-224aa49d3faa tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.961s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Acquiring lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG os_brick.utils [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b409d365-d5f4-47bf-9d99-e1193247e0af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd332fc-2d17-4af2-926d-4b7ed6090286]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33f19fc-cff1-4411-84a2-003be7615a99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8b0ffd-5536-4050-821c-27fbf44749be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:13:53 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:13:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5386e7c7-af03-425e-b3d7-23ec0fee091f]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:13:53 user nova-compute[72447]: DEBUG os_brick.utils [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBklFdXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:54 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:54 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:54 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7f9398-9278-44e2-a6d3-bbbaa93c8abb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:13:54 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[90600508-62aa-4517-a2d1-1a08f8440a81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536] added
Jul 31 12:13:54 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd3cedc-0b17-4187-ac78-181344e30f7f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3c383c-3e38-4456-be28-e8dfd87d3a3e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBklFdXD {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:54 user nova-compute[72447]: INFO nova.compute.manager [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Swapping volume a28358f8-4d88-4fc4-a56c-16df5d2b0793 for 98d2481b-ed84-43c9-af4e-c98f04982110
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBklFdXD" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4bf693-98ea-421f-a879-6df27d6a8c0b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WBklFdXD'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfad195e-67c1-4c8f-bf0f-c8e776b2c47d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a089b463-4725-4dbf-9eba-c20cf193045e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebf0862-84d4-4ffe-b9d6-a8c697c8ed74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536, portal: 172.16.0.220,3260]
Jul 31 12:13:54 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536, portal: 172.16.0.220,3260] successful.
Jul 31 12:13:54 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fd92db-e107-4e27-9b5f-8d4299a8b9c7]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[df743c56-6d86-418c-9a8a-8ff18fb8e2b8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:54 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:54 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc96d9ad-a9b2-4301-b21e-6568bcf27f93]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:54 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: None {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:13:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:13:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBklFdXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:13:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23837373562346432', 'path': '/dev/sdi'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837373562346432', 'path': '/dev/sdi'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:13:55 user nova-compute[72447]: DEBUG nova.objects.instance [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lazy-loading 'flavor' on Instance uuid b2cab306-7667-47cf-a689-75ad6d6b5dc3 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:13:55 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:13:55 user nova-compute[72447]:   <source dev="/dev/sdi"/>
Jul 31 12:13:55 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:13:55 user nova-compute[72447]:   <serial>2ffe45e7-ec00-47cf-a529-8fd0d4680536</serial>
Jul 31 12:13:55 user nova-compute[72447]: </disk>
Jul 31 12:13:55 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:13:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:13:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] No VIF found with MAC fa:16:3e:64:3f:7e, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:13:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ed13073e-9aa2-46f7-8b2b-9a2adf6b37d7 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.055s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:57 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805622.6464705, fd2cf3ad-9409-44ea-9718-7fc6033bd0d8 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:13:57 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] VM Stopped (Lifecycle Event)
Jul 31 12:13:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-43f10b91-cb6c-4482-8cb9-cbd510a927cf None None] [instance: fd2cf3ad-9409-44ea-9718-7fc6033bd0d8] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:13:58 user nova-compute[72447]: INFO nova.compute.manager [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Detaching volume 2ffe45e7-ec00-47cf-a529-8fd0d4680536
Jul 31 12:13:58 user nova-compute[72447]: INFO nova.virt.block_device [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Attempting to driver detach volume 2ffe45e7-ec00-47cf-a529-8fd0d4680536 from mountpoint /dev/vdb
Jul 31 12:13:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Attempting to detach device vdb from instance b2cab306-7667-47cf-a689-75ad6d6b5dc3 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:13:58 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:13:58 user nova-compute[72447]:   <source dev="/dev/sdi"/>
Jul 31 12:13:58 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:13:58 user nova-compute[72447]:   <serial>2ffe45e7-ec00-47cf-a529-8fd0d4680536</serial>
Jul 31 12:13:58 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:13:58 user nova-compute[72447]: </disk>
Jul 31 12:13:58 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:13:58 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Successfully detached device vdb from instance b2cab306-7667-47cf-a689-75ad6d6b5dc3 from the persistent domain config.
Jul 31 12:13:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2cab306-7667-47cf-a689-75ad6d6b5dc3 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:13:58 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:13:58 user nova-compute[72447]:   <source dev="/dev/sdi"/>
Jul 31 12:13:58 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:13:58 user nova-compute[72447]:   <serial>2ffe45e7-ec00-47cf-a529-8fd0d4680536</serial>
Jul 31 12:13:58 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:13:58 user nova-compute[72447]: </disk>
Jul 31 12:13:58 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690805638.5241191, b2cab306-7667-47cf-a689-75ad6d6b5dc3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2cab306-7667-47cf-a689-75ad6d6b5dc3 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:13:58 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Successfully detached device vdb from instance b2cab306-7667-47cf-a689-75ad6d6b5dc3 from the live domain config.
Jul 31 12:13:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBklFdXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:13:58 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4044c6-b901-48a9-9443-a7a6f0adeb38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bd422c-7063-43ab-92f1-8ce6d7c832b4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:13:58 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:13:58 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0668700a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536'): ({'sdi'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Removing single pathed devices sdi {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ba4b72-4308-46a8-996a-9a224df13121]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18d858f-692a-443b-a964-0ace32d88861]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Flushing IO for device /dev/sdi {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a8ac6d-8b40-4c2f-9fec-38af5cc45491]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[863c3dfd-5bfc-47bb-9b74-ee374fa9f1ae]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] SCSI volumes sdi have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3196ecd6-d87c-4307-a013-b6f31a2fa42f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[44db1f89-e4a7-4e5f-97fb-06a0b53c13a1]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536, portal: 172.16.0.220,3260]
Jul 31 12:13:58 user nova-compute[72447]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536, portal: 172.16.0.220,3260] successful.
Jul 31 12:13:58 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea8fb65-ea57-4e88-a845-444980da89e8]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] <== disconnect_volume: return (340ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:13:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-9d43f3fa-eb84-4261-9c2c-f775bb39bb18 req-0b92e41e-32bb-4d3d-8702-c9d478048afe service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-changed-fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:13:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-9d43f3fa-eb84-4261-9c2c-f775bb39bb18 req-0b92e41e-32bb-4d3d-8702-c9d478048afe service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing instance network info cache due to event network-changed-fcc49a84-024d-42ad-a1fd-562c666a071d. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:13:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9d43f3fa-eb84-4261-9c2c-f775bb39bb18 req-0b92e41e-32bb-4d3d-8702-c9d478048afe service nova] Acquiring lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:13:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9d43f3fa-eb84-4261-9c2c-f775bb39bb18 req-0b92e41e-32bb-4d3d-8702-c9d478048afe service nova] Acquired lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:13:59 user nova-compute[72447]: DEBUG nova.network.neutron [req-9d43f3fa-eb84-4261-9c2c-f775bb39bb18 req-0b92e41e-32bb-4d3d-8702-c9d478048afe service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Refreshing network info cache for port fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:13:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:13:59 user nova-compute[72447]: DEBUG nova.network.neutron [req-9d43f3fa-eb84-4261-9c2c-f775bb39bb18 req-0b92e41e-32bb-4d3d-8702-c9d478048afe service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updated VIF entry in instance network info cache for port fcc49a84-024d-42ad-a1fd-562c666a071d. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:13:59 user nova-compute[72447]: DEBUG nova.network.neutron [req-9d43f3fa-eb84-4261-9c2c-f775bb39bb18 req-0b92e41e-32bb-4d3d-8702-c9d478048afe service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [{"id": "fcc49a84-024d-42ad-a1fd-562c666a071d", "address": "fa:16:3e:ba:1d:6f", "network": {"id": "014cf20a-a0cd-4676-a16c-05f5ded0bed9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1838211978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc49a84-02", "ovs_interfaceid": "fcc49a84-024d-42ad-a1fd-562c666a071d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:13:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9d43f3fa-eb84-4261-9c2c-f775bb39bb18 req-0b92e41e-32bb-4d3d-8702-c9d478048afe service nova] Releasing lock "refresh_cache-52bef016-9676-446b-9a57-a43658e85e3c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:13:59 user nova-compute[72447]: DEBUG nova.objects.instance [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lazy-loading 'flavor' on Instance uuid b2cab306-7667-47cf-a689-75ad6d6b5dc3 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:13:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-25059a6c-3801-4420-9ce8-57baf34680d8 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.volume.cinder [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Update attachment failed for attachment 27ab9fa3-09a6-4bb9-af3e-a75a201b2d26. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 was not found.).). (HTTP 500) (Request-ID: req-4fcc3ab8-0d05-430b-8c7c-f3643281b520) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 was not found.).). (HTTP 500) (Request-ID: req-4fcc3ab8-0d05-430b-8c7c-f3643281b520)
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Failed to connect to volume 98d2481b-ed84-43c9-af4e-c98f04982110 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 was not found.).). (HTTP 500) (Request-ID: req-4fcc3ab8-0d05-430b-8c7c-f3643281b520)
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Traceback (most recent call last):
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     old_cinfo, new_cinfo = self._init_volume_connection(
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     new_cinfo = self.volume_api.attachment_update(
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     res = method(self, ctx, *args, **kwargs)
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     res = method(self, ctx, attachment_id, *args, **kwargs)
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     with excutils.save_and_reraise_exception():
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     self.force_reraise()
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     raise self.value
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     context, '3.44', skip_version_check=True).attachments.update(
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     return method.func(obj, *args, **kwargs)
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     resp = self._update('/attachments/%s' % id, body)
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     resp, body = self.api.client.put(url, body=body, **kwargs)
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     return self._cs_request(url, 'PUT', **kwargs)
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     return self.request(url, method, **kwargs)
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c]     raise exceptions.from_response(resp, body)
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 was not found.).). (HTTP 500) (Request-ID: req-4fcc3ab8-0d05-430b-8c7c-f3643281b520)
Jul 31 12:13:59 user nova-compute[72447]: ERROR nova.compute.manager [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] 
Jul 31 12:14:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 6.258s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server [None req-36700361-4822-48c4-a189-8eeafd6155ee tempest-TestVolumeSwap-1897323121 tempest-TestVolumeSwap-1897323121-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 was not found.).). (HTTP 500) (Request-ID: req-4fcc3ab8-0d05-430b-8c7c-f3643281b520)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7823, in swap_volume
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py", line 414, in inner
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7821, in _do_locked_swap_volume
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7865, in _do_swap_volume
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7714, in _swap_volume
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:98d2481b-ed84-43c9-af4e-c98f04982110/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2ffe45e7-ec00-47cf-a529-8fd0d4680536 was not found.).). (HTTP 500) (Request-ID: req-4fcc3ab8-0d05-430b-8c7c-f3643281b520)
Jul 31 12:14:00 user nova-compute[72447]: ERROR oslo_messaging.rpc.server 
Jul 31 12:14:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "52bef016-9676-446b-9a57-a43658e85e3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:01 user nova-compute[72447]: INFO nova.compute.manager [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Terminating instance
Jul 31 12:14:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG nova.compute.manager [req-ed4fd507-db5e-4a71-b666-9d15973b4a61 req-be6fb232-3ac8-42e6-84c8-bda8910a6c4a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ed4fd507-db5e-4a71-b666-9d15973b4a61 req-be6fb232-3ac8-42e6-84c8-bda8910a6c4a service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ed4fd507-db5e-4a71-b666-9d15973b4a61 req-be6fb232-3ac8-42e6-84c8-bda8910a6c4a service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ed4fd507-db5e-4a71-b666-9d15973b4a61 req-be6fb232-3ac8-42e6-84c8-bda8910a6c4a service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG nova.compute.manager [req-ed4fd507-db5e-4a71-b666-9d15973b4a61 req-be6fb232-3ac8-42e6-84c8-bda8910a6c4a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-unplugged-fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG nova.compute.manager [req-ed4fd507-db5e-4a71-b666-9d15973b4a61 req-be6fb232-3ac8-42e6-84c8-bda8910a6c4a service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-fcc49a84-024d-42ad-a1fd-562c666a071d for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-8cef29e7-8c9a-4371-9a41-0891ac1795f6 req-1bcfdd56-317b-42de-9c73-d5b9cdd5dc51 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-0a08866a-ddc0-4637-a4f0-49fddc70fa85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8cef29e7-8c9a-4371-9a41-0891ac1795f6 req-1bcfdd56-317b-42de-9c73-d5b9cdd5dc51 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8cef29e7-8c9a-4371-9a41-0891ac1795f6 req-1bcfdd56-317b-42de-9c73-d5b9cdd5dc51 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8cef29e7-8c9a-4371-9a41-0891ac1795f6 req-1bcfdd56-317b-42de-9c73-d5b9cdd5dc51 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-8cef29e7-8c9a-4371-9a41-0891ac1795f6 req-1bcfdd56-317b-42de-9c73-d5b9cdd5dc51 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-unplugged-0a08866a-ddc0-4637-a4f0-49fddc70fa85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-8cef29e7-8c9a-4371-9a41-0891ac1795f6 req-1bcfdd56-317b-42de-9c73-d5b9cdd5dc51 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-0a08866a-ddc0-4637-a4f0-49fddc70fa85 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-c2ef9261-7da4-4125-b2b6-03cd86379ab4 req-0bfff12d-8905-4bcd-8c8a-71b5485b6bb7 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c2ef9261-7da4-4125-b2b6-03cd86379ab4 req-0bfff12d-8905-4bcd-8c8a-71b5485b6bb7 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c2ef9261-7da4-4125-b2b6-03cd86379ab4 req-0bfff12d-8905-4bcd-8c8a-71b5485b6bb7 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c2ef9261-7da4-4125-b2b6-03cd86379ab4 req-0bfff12d-8905-4bcd-8c8a-71b5485b6bb7 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-c2ef9261-7da4-4125-b2b6-03cd86379ab4 req-0bfff12d-8905-4bcd-8c8a-71b5485b6bb7 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-unplugged-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-c2ef9261-7da4-4125-b2b6-03cd86379ab4 req-0bfff12d-8905-4bcd-8c8a-71b5485b6bb7 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Instance destroyed successfully.
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lazy-loading 'resources' on Instance uuid 52bef016-9676-446b-9a57-a43658e85e3c {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcc49a84-024d-42ad-a1fd-562c666a071d", "address": "fa:16:3e:ba:1d:6f", "network": {"id": "014cf20a-a0cd-4676-a16c-05f5ded0bed9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1838211978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc49a84-02", "ovs_interfaceid": "fcc49a84-024d-42ad-a1fd-562c666a071d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "fcc49a84-024d-42ad-a1fd-562c666a071d", "address": "fa:16:3e:ba:1d:6f", "network": {"id": "014cf20a-a0cd-4676-a16c-05f5ded0bed9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1838211978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc49a84-02", "ovs_interfaceid": "fcc49a84-024d-42ad-a1fd-562c666a071d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1d:6f,bridge_name='br-int',has_traffic_filtering=True,id=fcc49a84-024d-42ad-a1fd-562c666a071d,network=Network(014cf20a-a0cd-4676-a16c-05f5ded0bed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc49a84-02') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1d:6f,bridge_name='br-int',has_traffic_filtering=True,id=fcc49a84-024d-42ad-a1fd-562c666a071d,network=Network(014cf20a-a0cd-4676-a16c-05f5ded0bed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc49a84-02') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcc49a84-02, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: INFO os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1d:6f,bridge_name='br-int',has_traffic_filtering=True,id=fcc49a84-024d-42ad-a1fd-562c666a071d,network=Network(014cf20a-a0cd-4676-a16c-05f5ded0bed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc49a84-02')
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:3f:58,bridge_name='br-int',has_traffic_filtering=True,id=0a08866a-ddc0-4637-a4f0-49fddc70fa85,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a08866a-dd') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:3f:58,bridge_name='br-int',has_traffic_filtering=True,id=0a08866a-ddc0-4637-a4f0-49fddc70fa85,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a08866a-dd') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a08866a-dd, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: INFO os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:3f:58,bridge_name='br-int',has_traffic_filtering=True,id=0a08866a-ddc0-4637-a4f0-49fddc70fa85,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a08866a-dd')
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:96:18,bridge_name='br-int',has_traffic_filtering=True,id=7ee2883e-7b34-4e10-afdf-ef20340172fb,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee2883e-7b') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:96:18,bridge_name='br-int',has_traffic_filtering=True,id=7ee2883e-7b34-4e10-afdf-ef20340172fb,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee2883e-7b') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ee2883e-7b, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: INFO os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:96:18,bridge_name='br-int',has_traffic_filtering=True,id=7ee2883e-7b34-4e10-afdf-ef20340172fb,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee2883e-7b')
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=e35b56c3-881b-4cc2-bb6f-bab121fbf7a5,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35b56c3-88') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=e35b56c3-881b-4cc2-bb6f-bab121fbf7a5,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35b56c3-88') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape35b56c3-88, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: INFO os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=e35b56c3-881b-4cc2-bb6f-bab121fbf7a5,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35b56c3-88')
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:83:3a,bridge_name='br-int',has_traffic_filtering=True,id=433edca1-2807-4330-9b81-cadbecb3611a,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap433edca1-28') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:83:3a,bridge_name='br-int',has_traffic_filtering=True,id=433edca1-2807-4330-9b81-cadbecb3611a,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap433edca1-28') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap433edca1-28, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: INFO os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:83:3a,bridge_name='br-int',has_traffic_filtering=True,id=433edca1-2807-4330-9b81-cadbecb3611a,network=Network(bf5ec8d6-c449-4e2a-8547-aa83c366a2ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap433edca1-28')
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:cc:65,bridge_name='br-int',has_traffic_filtering=True,id=bb8a12fd-f418-4a88-865b-e7569c051282,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8a12fd-f4') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:cc:65,bridge_name='br-int',has_traffic_filtering=True,id=bb8a12fd-f418-4a88-865b-e7569c051282,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8a12fd-f4') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb8a12fd-f4, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: INFO os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:cc:65,bridge_name='br-int',has_traffic_filtering=True,id=bb8a12fd-f418-4a88-865b-e7569c051282,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8a12fd-f4')
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140366605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140366605',id=11,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAoIf0QMKWctKFCtG9l6XiS6p7I3uuK/kLUvZ6C+eoxfVZd/8ee3AxFvz+mTx7Ush5Bh9ZqAZDN3swx+6MWbLfjo9HzQ4SOepbzYQYEwcskn/swWaJt+5I6+UY4HsZSQA==',key_name='tempest-keypair-1071944621',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06a73529ad58419e8a49be4f43148353',ramdisk_id='',reservation_id='r-4ghnhd1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-999702660',owner_user_name='tempest-TaggedBootDevicesTest_v242-999702660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='500bca482db546ae912239c23755545b',uuid=52bef016-9676-446b-9a57-a43658e85e3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converting VIF {"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7a:04,bridge_name='br-int',has_traffic_filtering=True,id=16d5f5c4-8b11-4e78-b5ad-048300350e04,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d5f5c4-8b') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7a:04,bridge_name='br-int',has_traffic_filtering=True,id=16d5f5c4-8b11-4e78-b5ad-048300350e04,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d5f5c4-8b') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16d5f5c4-8b, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:03 user nova-compute[72447]: INFO os_vif [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:7a:04,bridge_name='br-int',has_traffic_filtering=True,id=16d5f5c4-8b11-4e78-b5ad-048300350e04,network=Network(0caac4fb-f71c-49b7-ac45-c015526c614f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d5f5c4-8b')
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dATGulmF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:14:03 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7eba02-8dc3-405c-a1d2-4408a2be2758]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a281359c-a5e3-46ab-a993-cca1b21b7be8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:14:03 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06685a7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06bbaee-40bb-42fa-b22c-213dc2c0496a]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f510d0-7555-453b-a129-b334a2944bd9]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1597a8-9609-402e-94ed-b69aa7be5900]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3de5902-fcef-43f2-ab61-d0979f75460a]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805628.8686318, 5b461cf8-5cb4-4dff-9bba-20930ec4ee84 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:14:03 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] VM Stopped (Lifecycle Event)
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5f2b9a-89c8-4a47-b3db-dc2c6579845f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9f1b1746-71e7-427c-9c3a-de05091859c4 None None] [instance: 5b461cf8-5cb4-4dff-9bba-20930ec4ee84] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[03805645-4436-4d1f-b757-81d746b75ab2]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7, portal: 172.16.0.220,3260]
Jul 31 12:14:03 user nova-compute[72447]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7, portal: 172.16.0.220,3260] successful.
Jul 31 12:14:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba3e9246-666a-4394-a2f8-598d2346dea7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f261a1b2-e3e3-442a-bb08-524fafe70e1d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] <== disconnect_volume: return (329ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:14:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKMsFilN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:14:04 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb87c92c-13a5-4d30-8026-f0fc9d2985aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:04 user nova-compute[72447]: WARNING nova.compute.manager [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-fcc49a84-024d-42ad-a1fd-562c666a071d for instance with vm_state active and task_state deleting.
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-unplugged-bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-bb8a12fd-f418-4a88-865b-e7569c051282 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:04 user nova-compute[72447]: WARNING nova.compute.manager [req-18557fda-8072-4562-9266-abeb7b330ba5 req-12340f22-920e-4b77-920a-16d45bbb88c4 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-bb8a12fd-f418-4a88-865b-e7569c051282 for instance with vm_state active and task_state deleting.
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-0a08866a-ddc0-4637-a4f0-49fddc70fa85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-0a08866a-ddc0-4637-a4f0-49fddc70fa85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:04 user nova-compute[72447]: WARNING nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-0a08866a-ddc0-4637-a4f0-49fddc70fa85 for instance with vm_state active and task_state deleting.
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-7ee2883e-7b34-4e10-afdf-ef20340172fb {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-unplugged-7ee2883e-7b34-4e10-afdf-ef20340172fb {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-7ee2883e-7b34-4e10-afdf-ef20340172fb for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-7ee2883e-7b34-4e10-afdf-ef20340172fb {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-7ee2883e-7b34-4e10-afdf-ef20340172fb {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:04 user nova-compute[72447]: WARNING nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-7ee2883e-7b34-4e10-afdf-ef20340172fb for instance with vm_state active and task_state deleting.
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-unplugged-433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-433edca1-2807-4330-9b81-cadbecb3611a for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:04 user nova-compute[72447]: WARNING nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-433edca1-2807-4330-9b81-cadbecb3611a for instance with vm_state active and task_state deleting.
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-unplugged-16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-31d01b31-35bf-49e6-9030-55cca3086d19 req-f9219a54-f283-4e00-ab67-cad529215d36 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-unplugged-16d5f5c4-8b11-4e78-b5ad-048300350e04 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd15e884-46db-485f-a247-f85233c2b16b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0668538f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621'): ({'sdc'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Removing single pathed devices sdc {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5c071e-d535-4ac0-9168-90ce17505ab6]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f31483b-4622-4da1-addc-6308f9b031bc]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Flushing IO for device /dev/sdc {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8b9b39-a9c7-4267-b056-780c110c6eef]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf9953e-ef9c-4ccc-9453-bcc50f932420]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcba21f-61b5-4110-923f-362ad1ab9873]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-f039b6e0-7630-4409-a5e5-03ee3297c468 req-21738a24-d509-4c5e-b2c1-f6438ab32776 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f039b6e0-7630-4409-a5e5-03ee3297c468 req-21738a24-d509-4c5e-b2c1-f6438ab32776 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f039b6e0-7630-4409-a5e5-03ee3297c468 req-21738a24-d509-4c5e-b2c1-f6438ab32776 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f039b6e0-7630-4409-a5e5-03ee3297c468 req-21738a24-d509-4c5e-b2c1-f6438ab32776 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-f039b6e0-7630-4409-a5e5-03ee3297c468 req-21738a24-d509-4c5e-b2c1-f6438ab32776 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:04 user nova-compute[72447]: WARNING nova.compute.manager [req-f039b6e0-7630-4409-a5e5-03ee3297c468 req-21738a24-d509-4c5e-b2c1-f6438ab32776 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 for instance with vm_state active and task_state deleting.
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d71bf0-0b18-4d62-9b4c-0a2557c9dc34]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621, portal: 172.16.0.220,3260]
Jul 31 12:14:04 user nova-compute[72447]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621, portal: 172.16.0.220,3260] successful.
Jul 31 12:14:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c4aab1b-840a-4240-890f-e1116b904621 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd28b43-89b3-4de9-8e15-78e9a5ada217]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] <== disconnect_volume: return (404ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxGPQHmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:14:04 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[83baa0ea-9735-457c-9c0f-f07914d82dfe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3608c8-ce12-4811-a2d4-00a9d51c5373]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:14:04 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f067c426cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925'): ({'sdd'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Removing single pathed devices sdd {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd62b02-1a90-4e6e-93fe-5c440a7a54c1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1d46f1-453e-4389-8a77-be07f0b0ce2b]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Flushing IO for device /dev/sdd {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e304d4b-01fe-4d61-a2ae-971594e4824d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2a7e97-2263-475c-a5c5-061ec6511f03]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[df575f31-34ef-4f52-9059-af41ecc0962f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a49ddd-081b-40d8-93ac-f0ef6c748b22]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925, portal: 172.16.0.220,3260]
Jul 31 12:14:04 user nova-compute[72447]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925, portal: 172.16.0.220,3260] successful.
Jul 31 12:14:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49bca79e-a9f2-486c-b313-7cadf2112925 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[613ab583-012a-4e4b-9511-67dde39ee643]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] <== disconnect_volume: return (300ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:14:04 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Deleting instance files /opt/stack/data/nova/instances/52bef016-9676-446b-9a57-a43658e85e3c_del
Jul 31 12:14:04 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Deletion of /opt/stack/data/nova/instances/52bef016-9676-446b-9a57-a43658e85e3c_del complete
Jul 31 12:14:04 user nova-compute[72447]: INFO nova.compute.manager [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Took 3.26 seconds to destroy the instance on the hypervisor.
Jul 31 12:14:04 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:14:04 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:14:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-acdb0f61-f347-4327-888e-332490338266 req-4ffac579-55e2-4e4f-8d82-f34123e688c6 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-changed-756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-acdb0f61-f347-4327-888e-332490338266 req-4ffac579-55e2-4e4f-8d82-f34123e688c6 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing instance network info cache due to event network-changed-756e0675-b763-4145-a0cf-d9f9f9cbe15d. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:14:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-acdb0f61-f347-4327-888e-332490338266 req-4ffac579-55e2-4e4f-8d82-f34123e688c6 service nova] Acquiring lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:14:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-acdb0f61-f347-4327-888e-332490338266 req-4ffac579-55e2-4e4f-8d82-f34123e688c6 service nova] Acquired lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:14:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-acdb0f61-f347-4327-888e-332490338266 req-4ffac579-55e2-4e4f-8d82-f34123e688c6 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Refreshing network info cache for port 756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:14:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-1c30a5d1-1db4-4dd2-aaef-d24c81fdef29 req-646acfd2-859d-40cb-8d50-17ef73bfecc5 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-plugged-16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1c30a5d1-1db4-4dd2-aaef-d24c81fdef29 req-646acfd2-859d-40cb-8d50-17ef73bfecc5 service nova] Acquiring lock "52bef016-9676-446b-9a57-a43658e85e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1c30a5d1-1db4-4dd2-aaef-d24c81fdef29 req-646acfd2-859d-40cb-8d50-17ef73bfecc5 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1c30a5d1-1db4-4dd2-aaef-d24c81fdef29 req-646acfd2-859d-40cb-8d50-17ef73bfecc5 service nova] Lock "52bef016-9676-446b-9a57-a43658e85e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-1c30a5d1-1db4-4dd2-aaef-d24c81fdef29 req-646acfd2-859d-40cb-8d50-17ef73bfecc5 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] No waiting events found dispatching network-vif-plugged-16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:06 user nova-compute[72447]: WARNING nova.compute.manager [req-1c30a5d1-1db4-4dd2-aaef-d24c81fdef29 req-646acfd2-859d-40cb-8d50-17ef73bfecc5 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received unexpected event network-vif-plugged-16d5f5c4-8b11-4e78-b5ad-048300350e04 for instance with vm_state active and task_state deleting.
Jul 31 12:14:07 user nova-compute[72447]: DEBUG nova.network.neutron [req-acdb0f61-f347-4327-888e-332490338266 req-4ffac579-55e2-4e4f-8d82-f34123e688c6 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updated VIF entry in instance network info cache for port 756e0675-b763-4145-a0cf-d9f9f9cbe15d. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG nova.network.neutron [req-acdb0f61-f347-4327-888e-332490338266 req-4ffac579-55e2-4e4f-8d82-f34123e688c6 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating instance_info_cache with network_info: [{"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "254eff25-f6ed-48ae-b3e1-4474187862c3", "address": "fa:16:3e:64:d0:a8", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254eff25-f6", "ovs_interfaceid": "254eff25-f6ed-48ae-b3e1-4474187862c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-acdb0f61-f347-4327-888e-332490338266 req-4ffac579-55e2-4e4f-8d82-f34123e688c6 service nova] Releasing lock "refresh_cache-8ddee7bd-86de-4bac-84c4-a8813ad9e985" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:07 user nova-compute[72447]: INFO nova.compute.manager [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Terminating instance
Jul 31 12:14:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-0a7652fe-822c-4362-a566-a9837bf3a508 req-cbebc89e-3f36-44ff-9d8b-cc574bc03cae service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0a7652fe-822c-4362-a566-a9837bf3a508 req-cbebc89e-3f36-44ff-9d8b-cc574bc03cae service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0a7652fe-822c-4362-a566-a9837bf3a508 req-cbebc89e-3f36-44ff-9d8b-cc574bc03cae service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0a7652fe-822c-4362-a566-a9837bf3a508 req-cbebc89e-3f36-44ff-9d8b-cc574bc03cae service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-0a7652fe-822c-4362-a566-a9837bf3a508 req-cbebc89e-3f36-44ff-9d8b-cc574bc03cae service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-unplugged-756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-0a7652fe-822c-4362-a566-a9837bf3a508 req-cbebc89e-3f36-44ff-9d8b-cc574bc03cae service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-756e0675-b763-4145-a0cf-d9f9f9cbe15d for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-5e159231-4151-4149-b2d9-226af0580841 req-ff6965e9-6119-4f74-bbc4-678b7d86187c service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5e159231-4151-4149-b2d9-226af0580841 req-ff6965e9-6119-4f74-bbc4-678b7d86187c service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5e159231-4151-4149-b2d9-226af0580841 req-ff6965e9-6119-4f74-bbc4-678b7d86187c service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5e159231-4151-4149-b2d9-226af0580841 req-ff6965e9-6119-4f74-bbc4-678b7d86187c service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-5e159231-4151-4149-b2d9-226af0580841 req-ff6965e9-6119-4f74-bbc4-678b7d86187c service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-unplugged-be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-5e159231-4151-4149-b2d9-226af0580841 req-ff6965e9-6119-4f74-bbc4-678b7d86187c service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-be660f99-0e0f-4622-8aa4-073606d35a33 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-91deb531-076f-486c-89ee-ce524503a9b0 req-ea919adc-c709-4cdd-adc1-4d6e59591fe2 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-deleted-fcc49a84-024d-42ad-a1fd-562c666a071d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:08 user nova-compute[72447]: INFO nova.compute.manager [req-91deb531-076f-486c-89ee-ce524503a9b0 req-ea919adc-c709-4cdd-adc1-4d6e59591fe2 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Neutron deleted interface fcc49a84-024d-42ad-a1fd-562c666a071d; detaching it from the instance and deleting it from the info cache
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.network.neutron [req-91deb531-076f-486c-89ee-ce524503a9b0 req-ea919adc-c709-4cdd-adc1-4d6e59591fe2 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [{"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb8a12fd-f418-4a88-865b-e7569c051282", "address": "fa:16:3e:df:cc:65", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8a12fd-f4", "ovs_interfaceid": "bb8a12fd-f418-4a88-865b-e7569c051282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-91deb531-076f-486c-89ee-ce524503a9b0 req-ea919adc-c709-4cdd-adc1-4d6e59591fe2 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Detach interface failed, port_id=fcc49a84-024d-42ad-a1fd-562c666a071d, reason: Instance 52bef016-9676-446b-9a57-a43658e85e3c could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-91deb531-076f-486c-89ee-ce524503a9b0 req-ea919adc-c709-4cdd-adc1-4d6e59591fe2 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-91deb531-076f-486c-89ee-ce524503a9b0 req-ea919adc-c709-4cdd-adc1-4d6e59591fe2 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-91deb531-076f-486c-89ee-ce524503a9b0 req-ea919adc-c709-4cdd-adc1-4d6e59591fe2 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-91deb531-076f-486c-89ee-ce524503a9b0 req-ea919adc-c709-4cdd-adc1-4d6e59591fe2 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-91deb531-076f-486c-89ee-ce524503a9b0 req-ea919adc-c709-4cdd-adc1-4d6e59591fe2 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-unplugged-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-91deb531-076f-486c-89ee-ce524503a9b0 req-ea919adc-c709-4cdd-adc1-4d6e59591fe2 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Instance destroyed successfully.
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.objects.instance [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lazy-loading 'resources' on Instance uuid 8ddee7bd-86de-4bac-84c4-a8813ad9e985 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3e:59,bridge_name='br-int',has_traffic_filtering=True,id=756e0675-b763-4145-a0cf-d9f9f9cbe15d,network=Network(85481ea7-4b24-411b-9c56-ec9715dd467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756e0675-b7') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3e:59,bridge_name='br-int',has_traffic_filtering=True,id=756e0675-b763-4145-a0cf-d9f9f9cbe15d,network=Network(85481ea7-4b24-411b-9c56-ec9715dd467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756e0675-b7') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap756e0675-b7, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: INFO os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3e:59,bridge_name='br-int',has_traffic_filtering=True,id=756e0675-b763-4145-a0cf-d9f9f9cbe15d,network=Network(85481ea7-4b24-411b-9c56-ec9715dd467d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap756e0675-b7')
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:b3:20,bridge_name='br-int',has_traffic_filtering=True,id=c6f127c0-48e3-47d0-8596-e25666488558,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6f127c0-48') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:b3:20,bridge_name='br-int',has_traffic_filtering=True,id=c6f127c0-48e3-47d0-8596-e25666488558,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6f127c0-48') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6f127c0-48, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: INFO os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:b3:20,bridge_name='br-int',has_traffic_filtering=True,id=c6f127c0-48e3-47d0-8596-e25666488558,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6f127c0-48')
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:12:af,bridge_name='br-int',has_traffic_filtering=True,id=1e5180c3-e48d-4eed-953b-41b1fe9f9d22,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e5180c3-e4') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:12:af,bridge_name='br-int',has_traffic_filtering=True,id=1e5180c3-e48d-4eed-953b-41b1fe9f9d22,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e5180c3-e4') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e5180c3-e4, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: INFO os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:12:af,bridge_name='br-int',has_traffic_filtering=True,id=1e5180c3-e48d-4eed-953b-41b1fe9f9d22,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e5180c3-e4')
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:24:e5,bridge_name='br-int',has_traffic_filtering=True,id=be660f99-0e0f-4622-8aa4-073606d35a33,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe660f99-0e') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:24:e5,bridge_name='br-int',has_traffic_filtering=True,id=be660f99-0e0f-4622-8aa4-073606d35a33,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe660f99-0e') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe660f99-0e, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: INFO os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:24:e5,bridge_name='br-int',has_traffic_filtering=True,id=be660f99-0e0f-4622-8aa4-073606d35a33,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe660f99-0e')
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:1e:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f72ad96-4cdb-40f6-b12d-99b8a787709c,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72ad96-4c') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:1e:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f72ad96-4cdb-40f6-b12d-99b8a787709c,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72ad96-4c') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f72ad96-4c, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: INFO os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:1e:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f72ad96-4cdb-40f6-b12d-99b8a787709c,network=Network(0202af0b-167e-40ed-910d-5502ac0719ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72ad96-4c')
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=c2bd8892-ea08-477e-8aff-70be63dfe0e7,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2bd8892-ea') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=c2bd8892-ea08-477e-8aff-70be63dfe0e7,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2bd8892-ea') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2bd8892-ea, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: INFO os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=c2bd8892-ea08-477e-8aff-70be63dfe0e7,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2bd8892-ea')
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544130911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544130911',id=12,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVWFjCSbkQS/jWxwoT13Vv52m4XJRiTnT2qLyvuIKUhwnFng4fSuuIkB84PZZXOktXFIOcMAgSxXGe7glSH1mvX6/QMiO2/dGtIwe3xpRyi1aPjzCC8DAhd7KdmRt9W5w==',key_name='tempest-keypair-701411039',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88151ca93f3e49c1b60cba124db4eb6d',ramdisk_id='',reservation_id='r-4zt9ctc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1105585884',owner_user_name='tempest-TaggedBootDevicesTest-1105585884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b71fe0a0a0a047b9bcdd3f50630b550c',uuid=8ddee7bd-86de-4bac-84c4-a8813ad9e985,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254eff25-f6ed-48ae-b3e1-4474187862c3", "address": "fa:16:3e:64:d0:a8", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254eff25-f6", "ovs_interfaceid": "254eff25-f6ed-48ae-b3e1-4474187862c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converting VIF {"id": "254eff25-f6ed-48ae-b3e1-4474187862c3", "address": "fa:16:3e:64:d0:a8", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254eff25-f6", "ovs_interfaceid": "254eff25-f6ed-48ae-b3e1-4474187862c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:a8,bridge_name='br-int',has_traffic_filtering=True,id=254eff25-f6ed-48ae-b3e1-4474187862c3,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254eff25-f6') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:a8,bridge_name='br-int',has_traffic_filtering=True,id=254eff25-f6ed-48ae-b3e1-4474187862c3,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254eff25-f6') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap254eff25-f6, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: INFO os_vif [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d0:a8,bridge_name='br-int',has_traffic_filtering=True,id=254eff25-f6ed-48ae-b3e1-4474187862c3,network=Network(36fe65aa-59ff-4b94-ab51-6eef5f9a4814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254eff25-f6')
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUuxseqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:14:09 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3359a985-c730-4694-82bd-217089a275a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[41de0a8e-47fb-4e97-921b-a83976c9d916]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0668506290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554'): ({'sde'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Removing single pathed devices sde {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8020ca-870b-43d2-a06e-61aa74769b80]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2bf1dd-1ad1-4769-9328-3f2cd9ed6781]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Flushing IO for device /dev/sde {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2de996b-b223-435e-98c8-d4eb5d20e91a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a8105b-d09b-4285-85be-7e66b88061a9]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c66b3-8751-42dd-b81e-2fb34b17bf5a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5aa8f1-857b-4bc1-aefb-dec9b473bc27]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554, portal: 172.16.0.220,3260]
Jul 31 12:14:09 user nova-compute[72447]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554, portal: 172.16.0.220,3260] successful.
Jul 31 12:14:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd46ce5-571b-4b5d-9f61-f20341cd8554 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ad0f2f-ad4c-4980-a7d6-880876680b90]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] <== disconnect_volume: return (337ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bznVxWsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:14:09 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77d7940-b88f-4a7a-8f96-0f52782c3bf7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:09 user nova-compute[72447]: WARNING nova.compute.manager [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-756e0675-b763-4145-a0cf-d9f9f9cbe15d for instance with vm_state active and task_state deleting.
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-c6f127c0-48e3-47d0-8596-e25666488558 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-unplugged-c6f127c0-48e3-47d0-8596-e25666488558 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-c6f127c0-48e3-47d0-8596-e25666488558 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-c6f127c0-48e3-47d0-8596-e25666488558 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-c6f127c0-48e3-47d0-8596-e25666488558 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:09 user nova-compute[72447]: WARNING nova.compute.manager [req-759341e6-91a3-4a03-b196-b944e4962b2e req-aa0f99c6-009e-4554-babb-83a17657b3db service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-c6f127c0-48e3-47d0-8596-e25666488558 for instance with vm_state active and task_state deleting.
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0978a8a-1c43-41ef-9387-fbab157b73fe]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0668506950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33'): ({'sdf'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Removing single pathed devices sdf {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ce17b5-3f11-41b6-a825-e38c7ea77364]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14e8b4d-7130-47d8-a5e1-9106b672e6de]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Flushing IO for device /dev/sdf {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[98024e67-e3d2-4537-a5af-43dbd783aa7a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bebd6c0-5263-48d4-858d-7c0d950b54c7]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] SCSI volumes sdf have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6720dca1-f5a6-43f3-8362-5002490ecf96]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5063e370-bba2-4831-b929-43721754759a]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33, portal: 172.16.0.220,3260]
Jul 31 12:14:09 user nova-compute[72447]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33, portal: 172.16.0.220,3260] successful.
Jul 31 12:14:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1614182-a45f-4cf6-85eb-e266aff12e33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e97faa-e5ea-479c-b83b-90e36bc48666]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] <== disconnect_volume: return (289ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usfnFmvA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:14:09 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0ede30-f303-40fc-b694-4d5650fa8c27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a960864e-112f-444a-8885-022284f8c44d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4451c439-71d0-4e23-a570-5e4d86babce4 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f (non-flash)
Jul 31 12:14:09 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06685388b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f'): ({'sdg'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Removing single pathed devices sdg {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ca6d5e-6f6a-483c-8a81-aa2389dabff6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba69de4-6ee6-4737-ac3d-ff2958b87742]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Flushing IO for device /dev/sdg {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3bda4f-4dca-49cc-a398-5a7d5db859b6]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae493ca-5c60-47ab-8656-1d7b16ecb117]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] SCSI volumes sdg have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d912b0e-3368-4796-b972-a92998550fc7]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74d62b3-9541-4628-81a2-998fa982b059]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f, portal: 172.16.0.220,3260]
Jul 31 12:14:10 user nova-compute[72447]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f, portal: 172.16.0.220,3260] successful.
Jul 31 12:14:10 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d76102-adcd-480c-a172-8eb1ea1f170f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a10856-f062-4d27-833f-a23c22b19844]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] <== disconnect_volume: return (295ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:14:10 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Deleting instance files /opt/stack/data/nova/instances/8ddee7bd-86de-4bac-84c4-a8813ad9e985_del
Jul 31 12:14:10 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Deletion of /opt/stack/data/nova/instances/8ddee7bd-86de-4bac-84c4-a8813ad9e985_del complete
Jul 31 12:14:10 user nova-compute[72447]: INFO nova.compute.manager [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Took 3.07 seconds to destroy the instance on the hypervisor.
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:10 user nova-compute[72447]: WARNING nova.compute.manager [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-be660f99-0e0f-4622-8aa4-073606d35a33 for instance with vm_state active and task_state deleting.
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-unplugged-c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-c2bd8892-ea08-477e-8aff-70be63dfe0e7 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:10 user nova-compute[72447]: WARNING nova.compute.manager [req-1c7552c2-3b41-45e9-b4a8-cb1289492876 req-363333fc-7cb0-42f1-903f-1fcc06218550 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-c2bd8892-ea08-477e-8aff-70be63dfe0e7 for instance with vm_state active and task_state deleting.
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:10 user nova-compute[72447]: WARNING nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-1e5180c3-e48d-4eed-953b-41b1fe9f9d22 for instance with vm_state active and task_state deleting.
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-deleted-bb8a12fd-f418-4a88-865b-e7569c051282 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:10 user nova-compute[72447]: INFO nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Neutron deleted interface bb8a12fd-f418-4a88-865b-e7569c051282; detaching it from the instance and deleting it from the info cache
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [{"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "address": "fa:16:3e:ac:7a:04", "network": {"id": "0caac4fb-f71c-49b7-ac45-c015526c614f", "bridge": "br-int", "label": "tempest-device-tagging-net2-40044815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d5f5c4-8b", "ovs_interfaceid": "16d5f5c4-8b11-4e78-b5ad-048300350e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Detach interface failed, port_id=bb8a12fd-f418-4a88-865b-e7569c051282, reason: Instance 52bef016-9676-446b-9a57-a43658e85e3c could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-unplugged-2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-2f72ad96-4cdb-40f6-b12d-99b8a787709c for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:10 user nova-compute[72447]: WARNING nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-2f72ad96-4cdb-40f6-b12d-99b8a787709c for instance with vm_state active and task_state deleting.
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-deleted-16d5f5c4-8b11-4e78-b5ad-048300350e04 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:10 user nova-compute[72447]: INFO nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Neutron deleted interface 16d5f5c4-8b11-4e78-b5ad-048300350e04; detaching it from the instance and deleting it from the info cache
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [{"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "433edca1-2807-4330-9b81-cadbecb3611a", "address": "fa:16:3e:04:83:3a", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap433edca1-28", "ovs_interfaceid": "433edca1-2807-4330-9b81-cadbecb3611a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Detach interface failed, port_id=16d5f5c4-8b11-4e78-b5ad-048300350e04, reason: Instance 52bef016-9676-446b-9a57-a43658e85e3c could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-unplugged-254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-unplugged-254eff25-f6ed-48ae-b3e1-4474187862c3 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-deleted-433edca1-2807-4330-9b81-cadbecb3611a {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:10 user nova-compute[72447]: INFO nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Neutron deleted interface 433edca1-2807-4330-9b81-cadbecb3611a; detaching it from the instance and deleting it from the info cache
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.network.neutron [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [{"id": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "address": "fa:16:3e:29:3f:58", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a08866a-dd", "ovs_interfaceid": "0a08866a-ddc0-4637-a4f0-49fddc70fa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "address": "fa:16:3e:61:96:18", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee2883e-7b", "ovs_interfaceid": "7ee2883e-7b34-4e10-afdf-ef20340172fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "address": "fa:16:3e:a0:97:b1", "network": {"id": "bf5ec8d6-c449-4e2a-8547-aa83c366a2ea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1807010434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "06a73529ad58419e8a49be4f43148353", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35b56c3-88", "ovs_interfaceid": "e35b56c3-881b-4cc2-bb6f-bab121fbf7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Detach interface failed, port_id=433edca1-2807-4330-9b81-cadbecb3611a, reason: Instance 52bef016-9676-446b-9a57-a43658e85e3c could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-plugged-254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Acquiring lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] No waiting events found dispatching network-vif-plugged-254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:10 user nova-compute[72447]: WARNING nova.compute.manager [req-b1ef320e-5ebf-4d9c-ba3c-ac3bbedee90a req-5813b8c6-0ca1-4d00-9483-e27cf955a637 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received unexpected event network-vif-plugged-254eff25-f6ed-48ae-b3e1-4474187862c3 for instance with vm_state active and task_state deleting.
Jul 31 12:14:10 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:14:10 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Took 5.69 seconds to deallocate network for instance.
Jul 31 12:14:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-690f9955-8fea-4940-ae8c-c464ea74a4d7 req-1e98b2a6-f7b6-4f64-b74e-b8e3e1c53f41 service nova] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Received event network-vif-deleted-e35b56c3-881b-4cc2-bb6f-bab121fbf7a5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-690f9955-8fea-4940-ae8c-c464ea74a4d7 req-1e98b2a6-f7b6-4f64-b74e-b8e3e1c53f41 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-deleted-254eff25-f6ed-48ae-b3e1-4474187862c3 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:12 user nova-compute[72447]: INFO nova.compute.manager [req-690f9955-8fea-4940-ae8c-c464ea74a4d7 req-1e98b2a6-f7b6-4f64-b74e-b8e3e1c53f41 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Neutron deleted interface 254eff25-f6ed-48ae-b3e1-4474187862c3; detaching it from the instance and deleting it from the info cache
Jul 31 12:14:12 user nova-compute[72447]: DEBUG nova.network.neutron [req-690f9955-8fea-4940-ae8c-c464ea74a4d7 req-1e98b2a6-f7b6-4f64-b74e-b8e3e1c53f41 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating instance_info_cache with network_info: [{"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "address": "fa:16:3e:21:1e:ec", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72ad96-4c", "ovs_interfaceid": "2f72ad96-4cdb-40f6-b12d-99b8a787709c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:14:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-690f9955-8fea-4940-ae8c-c464ea74a4d7 req-1e98b2a6-f7b6-4f64-b74e-b8e3e1c53f41 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Detach interface failed, port_id=254eff25-f6ed-48ae-b3e1-4474187862c3, reason: Instance 8ddee7bd-86de-4bac-84c4-a8813ad9e985 could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:14:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-690f9955-8fea-4940-ae8c-c464ea74a4d7 req-1e98b2a6-f7b6-4f64-b74e-b8e3e1c53f41 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-deleted-2f72ad96-4cdb-40f6-b12d-99b8a787709c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:12 user nova-compute[72447]: INFO nova.compute.manager [req-690f9955-8fea-4940-ae8c-c464ea74a4d7 req-1e98b2a6-f7b6-4f64-b74e-b8e3e1c53f41 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Neutron deleted interface 2f72ad96-4cdb-40f6-b12d-99b8a787709c; detaching it from the instance and deleting it from the info cache
Jul 31 12:14:12 user nova-compute[72447]: DEBUG nova.network.neutron [req-690f9955-8fea-4940-ae8c-c464ea74a4d7 req-1e98b2a6-f7b6-4f64-b74e-b8e3e1c53f41 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating instance_info_cache with network_info: [{"id": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "address": "fa:16:3e:ea:3e:59", "network": {"id": "85481ea7-4b24-411b-9c56-ec9715dd467d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-718107591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap756e0675-b7", "ovs_interfaceid": "756e0675-b763-4145-a0cf-d9f9f9cbe15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f127c0-48e3-47d0-8596-e25666488558", "address": "fa:16:3e:c9:b3:20", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f127c0-48", "ovs_interfaceid": "c6f127c0-48e3-47d0-8596-e25666488558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "address": "fa:16:3e:42:12:af", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5180c3-e4", "ovs_interfaceid": "1e5180c3-e48d-4eed-953b-41b1fe9f9d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be660f99-0e0f-4622-8aa4-073606d35a33", "address": "fa:16:3e:99:24:e5", "network": {"id": "0202af0b-167e-40ed-910d-5502ac0719ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-387024213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe660f99-0e", "ovs_interfaceid": "be660f99-0e0f-4622-8aa4-073606d35a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "address": "fa:16:3e:be:b1:0c", "network": {"id": "36fe65aa-59ff-4b94-ab51-6eef5f9a4814", "bridge": "br-int", "label": "tempest-device-tagging-net2-1909172022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88151ca93f3e49c1b60cba124db4eb6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2bd8892-ea", "ovs_interfaceid": "c2bd8892-ea08-477e-8aff-70be63dfe0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:14:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-690f9955-8fea-4940-ae8c-c464ea74a4d7 req-1e98b2a6-f7b6-4f64-b74e-b8e3e1c53f41 service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Detach interface failed, port_id=2f72ad96-4cdb-40f6-b12d-99b8a787709c, reason: Instance 8ddee7bd-86de-4bac-84c4-a8813ad9e985 could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:14:12 user nova-compute[72447]: INFO nova.compute.manager [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Took 2.23 seconds to detach 3 volumes for instance.
Jul 31 12:14:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:13 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:14:13 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:14:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:13 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Deleted allocations for instance 52bef016-9676-446b-9a57-a43658e85e3c
Jul 31 12:14:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9280b6e0-164a-4165-9577-83513e0de971 tempest-TaggedBootDevicesTest_v242-999702660 tempest-TaggedBootDevicesTest_v242-999702660-project-member] Lock "52bef016-9676-446b-9a57-a43658e85e3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.815s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:13 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:14:13 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Took 3.60 seconds to deallocate network for instance.
Jul 31 12:14:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-7149b818-e640-45f4-9428-0afa64400fbf req-05873a25-e4d9-4c59-a1b8-d202585ba9cd service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-deleted-be660f99-0e0f-4622-8aa4-073606d35a33 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-7149b818-e640-45f4-9428-0afa64400fbf req-05873a25-e4d9-4c59-a1b8-d202585ba9cd service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-deleted-756e0675-b763-4145-a0cf-d9f9f9cbe15d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-7149b818-e640-45f4-9428-0afa64400fbf req-05873a25-e4d9-4c59-a1b8-d202585ba9cd service nova] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Received event network-vif-deleted-c2bd8892-ea08-477e-8aff-70be63dfe0e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:16 user nova-compute[72447]: INFO nova.compute.manager [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Took 2.30 seconds to detach 3 volumes for instance.
Jul 31 12:14:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:16 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:14:16 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:14:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:16 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Deleted allocations for instance 8ddee7bd-86de-4bac-84c4-a8813ad9e985
Jul 31 12:14:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-95b878f0-b4ca-4c6b-b2fa-a60c9c469040 tempest-TaggedBootDevicesTest-1105585884 tempest-TaggedBootDevicesTest-1105585884-project-member] Lock "8ddee7bd-86de-4bac-84c4-a8813ad9e985" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.507s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:18 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805643.2742085, 52bef016-9676-446b-9a57-a43658e85e3c => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:14:18 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] VM Stopped (Lifecycle Event)
Jul 31 12:14:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-13d519b4-4fa5-4ec8-8326-d001c328120b None None] [instance: 52bef016-9676-446b-9a57-a43658e85e3c] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:14:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:23 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805648.8568442, 8ddee7bd-86de-4bac-84c4-a8813ad9e985 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:14:23 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] VM Stopped (Lifecycle Event)
Jul 31 12:14:23 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0eff6490-2ace-4466-bb4d-8527c58c5b97 None None] [instance: 8ddee7bd-86de-4bac-84c4-a8813ad9e985] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:14:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:14:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:14:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:14:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:35 user nova-compute[72447]: INFO nova.compute.manager [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Terminating instance
Jul 31 12:14:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:14:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-182fae0e-9e01-4cc0-adec-d0cffa99a51d req-6df7b688-194a-4441-bec4-b8497536c4db service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-vif-unplugged-4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-182fae0e-9e01-4cc0-adec-d0cffa99a51d req-6df7b688-194a-4441-bec4-b8497536c4db service nova] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-182fae0e-9e01-4cc0-adec-d0cffa99a51d req-6df7b688-194a-4441-bec4-b8497536c4db service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-182fae0e-9e01-4cc0-adec-d0cffa99a51d req-6df7b688-194a-4441-bec4-b8497536c4db service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-182fae0e-9e01-4cc0-adec-d0cffa99a51d req-6df7b688-194a-4441-bec4-b8497536c4db service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] No waiting events found dispatching network-vif-unplugged-4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-182fae0e-9e01-4cc0-adec-d0cffa99a51d req-6df7b688-194a-4441-bec4-b8497536c4db service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-vif-unplugged-4607d653-6d85-46b9-b00e-39748d9afb78 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:36 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Instance destroyed successfully.
Jul 31 12:14:36 user nova-compute[72447]: DEBUG nova.objects.instance [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lazy-loading 'resources' on Instance uuid b8929e20-a1f2-4a9c-a0c8-e0241113f0af {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T12:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1947605890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1947605890',id=7,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn5YeitERNgZiavoklE86RU3W69tKvanqOuX1Z4JM4bRcMNOeZRTBb//da8RjvsuxuqMZXyuEd1IjLCPuMWJJvrbNo/sdXOTs0iSDWka1Ds3bPHY+Kbf22pgZ3qNjgNdg==',key_name='tempest-keypair-117256101',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9a05f78f7104db98fe0e537d3f22208',ramdisk_id='',reservation_id='r-7n456tj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1246153700',owner_user_name='tempest-TaggedAttachmentsTest-1246153700-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d71c3e48f72842709366c6ad635fca49',uuid=b8929e20-a1f2-4a9c-a0c8-e0241113f0af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converting VIF {"id": "4607d653-6d85-46b9-b00e-39748d9afb78", "address": "fa:16:3e:46:a9:05", "network": {"id": "e5e1be84-34e1-4fd8-88de-981e3c2898db", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-22269230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a05f78f7104db98fe0e537d3f22208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4607d653-6d", "ovs_interfaceid": "4607d653-6d85-46b9-b00e-39748d9afb78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:a9:05,bridge_name='br-int',has_traffic_filtering=True,id=4607d653-6d85-46b9-b00e-39748d9afb78,network=Network(e5e1be84-34e1-4fd8-88de-981e3c2898db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4607d653-6d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG os_vif [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:a9:05,bridge_name='br-int',has_traffic_filtering=True,id=4607d653-6d85-46b9-b00e-39748d9afb78,network=Network(e5e1be84-34e1-4fd8-88de-981e3c2898db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4607d653-6d') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4607d653-6d, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:36 user nova-compute[72447]: INFO os_vif [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:a9:05,bridge_name='br-int',has_traffic_filtering=True,id=4607d653-6d85-46b9-b00e-39748d9afb78,network=Network(e5e1be84-34e1-4fd8-88de-981e3c2898db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4607d653-6d')
Jul 31 12:14:36 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Deleting instance files /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af_del
Jul 31 12:14:36 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Deletion of /opt/stack/data/nova/instances/b8929e20-a1f2-4a9c-a0c8-e0241113f0af_del complete
Jul 31 12:14:36 user nova-compute[72447]: INFO nova.compute.manager [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 31 12:14:36 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:14:36 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:14:37 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:14:38 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Took 1.24 seconds to deallocate network for instance.
Jul 31 12:14:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-af52ad7c-a01c-4a66-bbee-a627e6a0354f req-ddbcbb0a-a2b8-43b4-8f41-96ac50fec339 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-vif-deleted-4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-71e7dac0-14d8-4b24-ab20-d6390a291228 req-70384d14-f3cc-43bb-91f1-7bd451c8afe9 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received event network-vif-plugged-4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-71e7dac0-14d8-4b24-ab20-d6390a291228 req-70384d14-f3cc-43bb-91f1-7bd451c8afe9 service nova] Acquiring lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-71e7dac0-14d8-4b24-ab20-d6390a291228 req-70384d14-f3cc-43bb-91f1-7bd451c8afe9 service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-71e7dac0-14d8-4b24-ab20-d6390a291228 req-70384d14-f3cc-43bb-91f1-7bd451c8afe9 service nova] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-71e7dac0-14d8-4b24-ab20-d6390a291228 req-70384d14-f3cc-43bb-91f1-7bd451c8afe9 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] No waiting events found dispatching network-vif-plugged-4607d653-6d85-46b9-b00e-39748d9afb78 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:38 user nova-compute[72447]: WARNING nova.compute.manager [req-71e7dac0-14d8-4b24-ab20-d6390a291228 req-70384d14-f3cc-43bb-91f1-7bd451c8afe9 service nova] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Received unexpected event network-vif-plugged-4607d653-6d85-46b9-b00e-39748d9afb78 for instance with vm_state deleted and task_state None.
Jul 31 12:14:38 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:14:38 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:14:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:38 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Deleted allocations for instance b8929e20-a1f2-4a9c-a0c8-e0241113f0af
Jul 31 12:14:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-881b05d6-ded2-453e-a69c-8399dabd44a3 tempest-TaggedAttachmentsTest-1246153700 tempest-TaggedAttachmentsTest-1246153700-project-member] Lock "b8929e20-a1f2-4a9c-a0c8-e0241113f0af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.627s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:43 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:14:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:45 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:14:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:14:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:14:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:14:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Jul 31 12:14:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-ba0c6dba-0035-4196-a05f-9335436fac86" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:14:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-ba0c6dba-0035-4196-a05f-9335436fac86" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:14:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:14:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Updating instance_info_cache with network_info: [{"id": "9bc7922e-33db-4822-a9b9-497abe3fb078", "address": "fa:16:3e:62:fc:84", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc7922e-33", "ovs_interfaceid": "9bc7922e-33db-4822-a9b9-497abe3fb078", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-ba0c6dba-0035-4196-a05f-9335436fac86" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG nova.objects.instance [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'flavor' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:47 user nova-compute[72447]: INFO nova.compute.manager [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Attaching volume 95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 to /dev/vdb
Jul 31 12:14:47 user nova-compute[72447]: DEBUG os_brick.utils [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa5cbf3-fb20-40e9-9a77-44a4ef262d53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a3ad28-02b2-467e-8bcd-33575f67972c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d595345-707b-4925-a929-95a96085d870]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cad0edd-2d22-467e-8be3-b331a6e22dfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:14:47 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4fb4a9-0b04-438b-a106-ec87e17416b3]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG os_brick.utils [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] <== get_connector_properties: return (224ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updating existing volume attachment record: eeadabca-a724-420b-9cea-83c32897b147 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:50 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:14:50 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:14:50 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7693MB free_disk=25.55046844482422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:14:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:50 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:14:50 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:14:50 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:14:50 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance ba0c6dba-0035-4196-a05f-9335436fac86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:14:50 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 700d80d6-9248-4d6f-9010-c3904d8fec2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:14:50 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b2cab306-7667-47cf-a689-75ad6d6b5dc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:14:50 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 10919978-d29f-42b7-b091-309d7202b6ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:14:50 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:14:50 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "6c701045-e520-421f-94d2-b54edd0d5c54" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:51 user nova-compute[72447]: INFO nova.compute.manager [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Unshelving
Jul 31 12:14:51 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805676.661372, b8929e20-a1f2-4a9c-a0c8-e0241113f0af => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:14:51 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] VM Stopped (Lifecycle Event)
Jul 31 12:14:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d97df911-3050-497c-8f8c-025934b08e83 None None] [instance: b8929e20-a1f2-4a9c-a0c8-e0241113f0af] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:51 user nova-compute[72447]: INFO nova.virt.block_device [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Booting with volume 05147714-4486-4123-b02d-acff59beea1f at /dev/vdc
Jul 31 12:14:51 user nova-compute[72447]: DEBUG os_brick.utils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad01a18-88f7-4bb7-8012-48939d241844]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c86d123-a673-401f-b66c-5aa7278c613a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad51f5b-6b1f-41fa-9ae8-1577f6eea3e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[123be819-9635-4485-9fc1-25c7688c0f6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:14:51 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:14:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3835eb-1afb-4a87-9b1f-917277f0cd1f]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:14:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:14:52 user nova-compute[72447]: DEBUG os_brick.utils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:14:52 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updating existing volume attachment record: 404132ac-9969-439e-8825-0e85bf1eba8c {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:14:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:14:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:14:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:14:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:14:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:14:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:14:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:55 user nova-compute[72447]: INFO nova.compute.manager [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Terminating instance
Jul 31 12:14:55 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:14:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:55 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Instance destroyed successfully.
Jul 31 12:14:55 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lazy-loading 'resources' on Instance uuid b2cab306-7667-47cf-a689-75ad6d6b5dc3 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1464141448',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1464141448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1464141',id=9,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzSRwdrS7HFcVV/AUQVpHoJOv7VZB5uyZ1XrnyY4Q9qfsW+DAE3QAy0BH6WvHFSf1g39nN1pNtPujRp9pTX1hKRjCoGQFIItj14ZArSmfVcUJ8nuwntRhG9Xm94hyfJdg==',key_name='tempest-keypair-734771203',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e36cca759ce84e3a8d8a1c33cba6a2ef',ramdisk_id='',reservation_id='r-mzb42qdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-118107813',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:11:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6017d502501b4f688268466fc29beed7',uuid=b2cab306-7667-47cf-a689-75ad6d6b5dc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5003425a-134e-472d-92e2-420de67a84e7", "address": "fa:16:3e:64:3f:7e", "network": {"id": "31deefaf-d6e3-4bbf-8398-236aecf427d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-89341723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36cca759ce84e3a8d8a1c33cba6a2ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5003425a-13", "ovs_interfaceid": "5003425a-134e-472d-92e2-420de67a84e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Converting VIF {"id": "5003425a-134e-472d-92e2-420de67a84e7", "address": "fa:16:3e:64:3f:7e", "network": {"id": "31deefaf-d6e3-4bbf-8398-236aecf427d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-89341723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36cca759ce84e3a8d8a1c33cba6a2ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5003425a-13", "ovs_interfaceid": "5003425a-134e-472d-92e2-420de67a84e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:3f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5003425a-134e-472d-92e2-420de67a84e7,network=Network(31deefaf-d6e3-4bbf-8398-236aecf427d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5003425a-13') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_vif [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:3f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5003425a-134e-472d-92e2-420de67a84e7,network=Network(31deefaf-d6e3-4bbf-8398-236aecf427d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5003425a-13') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5003425a-13, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:14:56 user nova-compute[72447]: INFO os_vif [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:3f:7e,bridge_name='br-int',has_traffic_filtering=True,id=5003425a-134e-472d-92e2-420de67a84e7,network=Network(31deefaf-d6e3-4bbf-8398-236aecf427d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5003425a-13')
Jul 31 12:14:56 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Deleting instance files /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3_del
Jul 31 12:14:56 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Deletion of /opt/stack/data/nova/instances/b2cab306-7667-47cf-a689-75ad6d6b5dc3_del complete
Jul 31 12:14:56 user nova-compute[72447]: INFO nova.compute.manager [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Took 1.07 seconds to destroy the instance on the hypervisor.
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIWJalSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:14:56 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:14:56 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:14:56 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29714ca-f77b-442a-b765-76bf53175d40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:14:56 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[90871458-bb9f-4709-ba42-afd1bac8968b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1] added
Jul 31 12:14:56 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-84e5e994-11e1-40a5-b050-633bda766b01 req-5014b31d-7723-4308-a283-6d0f80703a9d service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Received event network-vif-unplugged-5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-84e5e994-11e1-40a5-b050-633bda766b01 req-5014b31d-7723-4308-a283-6d0f80703a9d service nova] Acquiring lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-84e5e994-11e1-40a5-b050-633bda766b01 req-5014b31d-7723-4308-a283-6d0f80703a9d service nova] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-84e5e994-11e1-40a5-b050-633bda766b01 req-5014b31d-7723-4308-a283-6d0f80703a9d service nova] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-84e5e994-11e1-40a5-b050-633bda766b01 req-5014b31d-7723-4308-a283-6d0f80703a9d service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] No waiting events found dispatching network-vif-unplugged-5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-84e5e994-11e1-40a5-b050-633bda766b01 req-5014b31d-7723-4308-a283-6d0f80703a9d service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Received event network-vif-unplugged-5003425a-134e-472d-92e2-420de67a84e7 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ecc88c-1025-477e-ac3c-4673e74b067b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6308c298-4258-4821-8c86-ac07e141c849]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gIWJalSA {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gIWJalSA" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca9e57d-f1bc-43d8-a7e6-1694e19368dc]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gIWJalSA'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ddf2d9-ddd3-4eae-a3c1-c17d52087ad6]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[141e68df-267c-4028-8961-778b63f11e5d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:56 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:56 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:56 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:56 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a72aac8-3328-4620-98b3-cdeaa125462a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1, portal: 172.16.0.220,3260]
Jul 31 12:14:56 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1, portal: 172.16.0.220,3260] successful.
Jul 31 12:14:56 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[83edaf5c-9c54-4921-ac05-59cae107b774]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe88432-9fdf-4c1b-97d1-bc4a13695e0e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:57 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:14:57 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:14:57 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:14:57 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:14:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0bea60-765f-4acd-8fc4-7f6402959fd5]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:14:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIWJalSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23466306636376663', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466306636376663', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG nova.objects.instance [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'flavor' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:14:58 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:14:58 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:14:58 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:14:58 user nova-compute[72447]:   <serial>95e9db9e-2f16-4182-93fa-6e4e6c70b6e1</serial>
Jul 31 12:14:58 user nova-compute[72447]: </disk>
Jul 31 12:14:58 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:14:58 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Took 2.01 seconds to deallocate network for instance.
Jul 31 12:14:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] No VIF found with MAC fa:16:3e:d4:43:3e, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:58 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Deleted allocations for instance b2cab306-7667-47cf-a689-75ad6d6b5dc3
Jul 31 12:14:58 user nova-compute[72447]: DEBUG nova.compute.manager [req-c23f9843-554e-46ce-b51a-95cc04c71fe3 req-aae27877-fe1b-478b-a665-e0636ab9c37c service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Received event network-vif-plugged-5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c23f9843-554e-46ce-b51a-95cc04c71fe3 req-aae27877-fe1b-478b-a665-e0636ab9c37c service nova] Acquiring lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c23f9843-554e-46ce-b51a-95cc04c71fe3 req-aae27877-fe1b-478b-a665-e0636ab9c37c service nova] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c23f9843-554e-46ce-b51a-95cc04c71fe3 req-aae27877-fe1b-478b-a665-e0636ab9c37c service nova] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG nova.compute.manager [req-c23f9843-554e-46ce-b51a-95cc04c71fe3 req-aae27877-fe1b-478b-a665-e0636ab9c37c service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] No waiting events found dispatching network-vif-plugged-5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:14:58 user nova-compute[72447]: WARNING nova.compute.manager [req-c23f9843-554e-46ce-b51a-95cc04c71fe3 req-aae27877-fe1b-478b-a665-e0636ab9c37c service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Received unexpected event network-vif-plugged-5003425a-134e-472d-92e2-420de67a84e7 for instance with vm_state deleted and task_state None.
Jul 31 12:14:58 user nova-compute[72447]: DEBUG nova.compute.manager [req-c23f9843-554e-46ce-b51a-95cc04c71fe3 req-aae27877-fe1b-478b-a665-e0636ab9c37c service nova] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Received event network-vif-deleted-5003425a-134e-472d-92e2-420de67a84e7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7aa17937-55ac-4782-9de0-054509c2778a tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.352s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4fdb198e-0b0a-4187-826a-548c78b05fc5 tempest-TestServerVolumeAttachScenarioOldVersion-118107813 tempest-TestServerVolumeAttachScenarioOldVersion-118107813-project-member] Lock "b2cab306-7667-47cf-a689-75ad6d6b5dc3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.876s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:14:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:14:59 user nova-compute[72447]: INFO nova.compute.manager [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Rescuing
Jul 31 12:14:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:14:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquired lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:14:59 user nova-compute[72447]: DEBUG nova.network.neutron [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:15:00 user nova-compute[72447]: DEBUG nova.network.neutron [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updating instance_info_cache with network_info: [{"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:15:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Releasing lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:15:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "2f98bc8b-537a-4b34-85ce-d7baac240046" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:15:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:00 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:15:00 user nova-compute[72447]: INFO nova.compute.claims [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Claim successful on node user
Jul 31 12:15:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.compute.manager [req-543e8686-8bdc-4701-af1e-2fd259d5f743 req-ec0093c6-03cf-4800-af47-a6b8ad4f2f67 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-unplugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-543e8686-8bdc-4701-af1e-2fd259d5f743 req-ec0093c6-03cf-4800-af47-a6b8ad4f2f67 service nova] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-543e8686-8bdc-4701-af1e-2fd259d5f743 req-ec0093c6-03cf-4800-af47-a6b8ad4f2f67 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-543e8686-8bdc-4701-af1e-2fd259d5f743 req-ec0093c6-03cf-4800-af47-a6b8ad4f2f67 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.compute.manager [req-543e8686-8bdc-4701-af1e-2fd259d5f743 req-ec0093c6-03cf-4800-af47-a6b8ad4f2f67 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] No waiting events found dispatching network-vif-unplugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:01 user nova-compute[72447]: WARNING nova.compute.manager [req-543e8686-8bdc-4701-af1e-2fd259d5f743 req-ec0093c6-03cf-4800-af47-a6b8ad4f2f67 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received unexpected event network-vif-unplugged-f276935a-5cfd-4a23-a87e-cbab33adf21e for instance with vm_state active and task_state rescuing.
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.network.neutron [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:15:01 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:15:01 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Instance destroyed successfully.
Jul 31 12:15:01 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Attempting a stable device rescue
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72447) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Instance directory exists: not creating {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 12:15:01 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Creating image(s)
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "/opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "/opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "/opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.objects.instance [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'trusted_certs' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:15:01 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Creating image(s)
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "/opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "/opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c.part --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG nova.policy [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0855a22b65634f1690901a5f9be8e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefc91464b24c68a6d7f9059ec58b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 1.056s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c.part --force-share --output=json" returned: 0 in 0.179s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG nova.virt.images [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] 32679fb9-d1c5-4d96-90e9-efbda55eaeb1 was qcow2, converting to raw {{(pid=72447) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c.part /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c.converted {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG nova.objects.instance [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'pci_requests' on Instance uuid 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.185s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG nova.objects.instance [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk 1073741824" returned: 0 in 0.078s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:15:03 user nova-compute[72447]: INFO nova.compute.claims [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Claim successful on node user
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c.part /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c.converted" returned: 0 in 0.242s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c.converted --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.compute.manager [req-dbb6ecc0-fb72-4e4e-ac0c-4cc6c7df8452 req-7f242c67-5235-491e-a8cd-30a1fb5b6bb7 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-dbb6ecc0-fb72-4e4e-ac0c-4cc6c7df8452 req-7f242c67-5235-491e-a8cd-30a1fb5b6bb7 service nova] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-dbb6ecc0-fb72-4e4e-ac0c-4cc6c7df8452 req-7f242c67-5235-491e-a8cd-30a1fb5b6bb7 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-dbb6ecc0-fb72-4e4e-ac0c-4cc6c7df8452 req-7f242c67-5235-491e-a8cd-30a1fb5b6bb7 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.compute.manager [req-dbb6ecc0-fb72-4e4e-ac0c-4cc6c7df8452 req-7f242c67-5235-491e-a8cd-30a1fb5b6bb7 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] No waiting events found dispatching network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:03 user nova-compute[72447]: WARNING nova.compute.manager [req-dbb6ecc0-fb72-4e4e-ac0c-4cc6c7df8452 req-7f242c67-5235-491e-a8cd-30a1fb5b6bb7 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received unexpected event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e for instance with vm_state active and task_state rescuing.
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.208s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c.converted --force-share --output=json" returned: 0 in 0.156s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.629s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Cannot resize image /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lazy-loading 'migration_context' on Instance uuid 2f98bc8b-537a-4b34-85ce-d7baac240046 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Ensure instance console log exists: /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c --force-share --output=json" returned: 0 in 0.195s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c,backing_fmt=raw /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.rescue {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c,backing_fmt=raw /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.rescue" returned: 0 in 0.063s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'migration_context' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Start _get_guest_xml network_info=[{"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "vif_mac": "fa:16:3e:d4:43:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '32679fb9-d1c5-4d96-90e9-efbda55eaeb1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'eeadabca-a724-420b-9cea-83c32897b147', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIWJalSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '87bc8e3c-6a96-4466-b6c0-390ba3f662a4', 'attached_at': '', 'detached_at': '', 'volume_id': '95e9db9e-2f16-4182-93fa-6e4e6c70b6e1', 'serial': '95e9db9e-2f16-4182-93fa-6e4e6c70b6e1'}, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'resources' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'numa_topology' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:03 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:15:03 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'vcpu_model' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIWJalSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:15:03 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:15:03 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:15:03 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c103761b-a9e1-4462-b6ba-6fe4ccb3be73]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gIWJalSA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 31 12:15:03 user nova-compute[72447]: node.name = iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1
Jul 31 12:15:03 user nova-compute[72447]: node.tpgt = -1
Jul 31 12:15:03 user nova-compute[72447]: node.startup = automatic
Jul 31 12:15:03 user nova-compute[72447]: node.leading_login = No
Jul 31 12:15:03 user nova-compute[72447]: iface.iscsi_ifacename = default
Jul 31 12:15:03 user nova-compute[72447]: iface.net_ifacename = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.ipaddress = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.prefix_len = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.hwaddress = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.transport_name = tcp
Jul 31 12:15:03 user nova-compute[72447]: iface.initiatorname = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.state = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.vlan_id = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.vlan_priority = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.vlan_state = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.iface_num = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.mtu = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.port = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.bootproto = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.subnet_mask = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.gateway = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.dhcp_alt_client_id_state = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.dhcp_alt_client_id = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.dhcp_dns = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.dhcp_learn_iqn = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.dhcp_req_vendor_id_state = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.dhcp_vendor_id_state = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.dhcp_vendor_id = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.dhcp_slp_da = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.fragmentation = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.gratuitous_arp = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.incoming_forwarding = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.tos_state = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.tos = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.ttl = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.delayed_ack = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.tcp_nagle = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.tcp_wsf_state = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.tcp_wsf = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.tcp_timer_scale = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.tcp_timestamp = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.redirect = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.def_task_mgmt_timeout = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.header_digest = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.data_digest = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.immediate_data = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.initial_r2t = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.data_seq_inorder = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.data_pdu_inorder = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.erl = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.max_receive_data_len = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.first_burst_len = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.max_outstanding_r2t = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.max_burst_len = 0
Jul 31 12:15:03 user nova-compute[72447]: iface.chap_auth = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.bidi_chap = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.strict_login_compliance = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.discovery_auth = <empty>
Jul 31 12:15:03 user nova-compute[72447]: iface.discovery_logout = <empty>
Jul 31 12:15:03 user nova-compute[72447]: node.discovery_address = <empty>
Jul 31 12:15:03 user nova-compute[72447]: node.discovery_port = 0
Jul 31 12:15:03 user nova-compute[72447]: node.discovery_type = static
Jul 31 12:15:03 user nova-compute[72447]: node.session.initial_cmdsn = 0
Jul 31 12:15:03 user nova-compute[72447]: node.session.initial_login_retry_max = 8
Jul 31 12:15:03 user nova-compute[72447]: node.session.xmit_thread_priority = -20
Jul 31 12:15:03 user nova-compute[72447]: node.session.cmds_max = 128
Jul 31 12:15:03 user nova-compute[72447]: node.session.queue_depth = 32
Jul 31 12:15:03 user nova-compute[72447]: node.session.nr_sessions = 1
Jul 31 12:15:03 user nova-compute[72447]: node.session.auth.authmethod = CHAP
Jul 31 12:15:03 user nova-compute[72447]: node.session.auth.username = gIWJalSA
Jul 31 12:15:03 user nova-compute[72447]: node.session.auth.password = ***
Jul 31 12:15:03 user nova-compute[72447]: node.session.auth.username_in = <empty>
Jul 31 12:15:03 user nova-compute[72447]: node.session.auth.password_in = <empty>
Jul 31 12:15:03 user nova-compute[72447]: node.session.auth.chap_algs = MD5
Jul 31 12:15:03 user nova-compute[72447]: node.session.timeo.replacement_timeout = 120
Jul 31 12:15:03 user nova-compute[72447]: node.session.err_timeo.abort_timeout = 15
Jul 31 12:15:03 user nova-compute[72447]: node.session.err_timeo.lu_reset_timeout = 30
Jul 31 12:15:03 user nova-compute[72447]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 31 12:15:03 user nova-compute[72447]: node.session.err_timeo.host_reset_timeout = 60
Jul 31 12:15:03 user nova-compute[72447]: node.session.iscsi.FastAbort = Yes
Jul 31 12:15:03 user nova-compute[72447]: node.session.iscsi.InitialR2T = No
Jul 31 12:15:03 user nova-compute[72447]: node.session.iscsi.ImmediateData = Yes
Jul 31 12:15:03 user nova-compute[72447]: node.session.iscsi.FirstBurstLength = 262144
Jul 31 12:15:03 user nova-compute[72447]: node.session.iscsi.MaxBurstLength = 16776192
Jul 31 12:15:03 user nova-compute[72447]: node.session.iscsi.DefaultTime2Retain = 0
Jul 31 12:15:03 user nova-compute[72447]: node.session.iscsi.DefaultTime2Wait = 2
Jul 31 12:15:03 user nova-compute[72447]: node.session.iscsi.MaxConnections = 1
Jul 31 12:15:03 user nova-compute[72447]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 31 12:15:03 user nova-compute[72447]: node.session.iscsi.ERL = 0
Jul 31 12:15:03 user nova-compute[72447]: node.session.scan = manual
Jul 31 12:15:03 user nova-compute[72447]: node.session.reopen_max = 0
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].address = 172.16.0.220
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].port = 3260
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].startup = manual
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].tcp.window_size = 524288
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].tcp.type_of_service = 0
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].timeo.logout_timeout = 15
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].timeo.login_timeout = 15
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].timeo.auth_timeout = 45
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].timeo.noop_out_interval = 5
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].timeo.noop_out_timeout = 5
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].iscsi.HeaderDigest = None
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].iscsi.DataDigest = None
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].iscsi.IFMarker = No
Jul 31 12:15:03 user nova-compute[72447]: node.conn[0].iscsi.OFMarker = No
Jul 31 12:15:03 user nova-compute[72447]: # END RECORD
Jul 31 12:15:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ca7efb-dcca-4ebc-8bf6-95a7baddf400]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.952s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ced25db-7234-4e14-94d5-09c1249ece54]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gIWJalSA {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gIWJalSA" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9f7aaf-7f9f-40d5-a3ca-cb61b0b8036f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gIWJalSA'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1eedc06-003d-4d9e-b72a-f95fa8ed0d7b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a471df-ef9f-4a5b-8ce2-5ad9a7693c7f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:15:03 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:15:03 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:15:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:15:03 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:15:03 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:15:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.197s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] HCTL ('33', '0', '0', 0) found on session 16 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.network.neutron [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Successfully created port: ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc1356d-d710-4e02-9169-740f86db998a]: (4, ('0 0 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Searching for a device in session 16 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIWJalSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.229s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] <== connect_volume: return (232ms) {'type': 'block', 'scsi_wwn': '23466306636376663', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466306636376663', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:15:03 user nova-compute[72447]: INFO nova.network.neutron [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updating port c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1381244369',display_name='tempest-ServerStableDeviceRescueTest-server-1381244369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1381244369',id=3,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1icZEpEEW/JxHuc33dr3gmsa/8MvvGYu3d89THxX8AOljRfbuMkiO1Klj1CI/oe8u3BcZwF6qZ2IQZEO3QiveEPEKjXw2X6F9Kqdh3YeZyF3J6aXC148RMxGv+f4OePw==',key_name='tempest-keypair-406421083',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='139411ad75fe4bdf9e858f4260dfa1c9',ramdisk_id='',reservation_id='r-ss8iel63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1013716252',owner_user_name='tempest-ServerStableDeviceRescueTest-1013716252-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:13:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de2fa3b70ec747628afaf3c707e6d5ca',uuid=87bc8e3c-6a96-4466-b6c0-390ba3f662a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "vif_mac": "fa:16:3e:d4:43:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Converting VIF {"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "vif_mac": "fa:16:3e:d4:43:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:43:3e,bridge_name='br-int',has_traffic_filtering=True,id=f276935a-5cfd-4a23-a87e-cbab33adf21e,network=Network(8876bd0f-8dd8-4fc8-bb2d-98c58e43afec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf276935a-5c') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:15:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'pci_devices' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:15:04 user nova-compute[72447]:   <uuid>87bc8e3c-6a96-4466-b6c0-390ba3f662a4</uuid>
Jul 31 12:15:04 user nova-compute[72447]:   <name>instance-00000003</name>
Jul 31 12:15:04 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:15:04 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:15:04 user nova-compute[72447]:   <metadata>
Jul 31 12:15:04 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:15:04 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:15:04 user nova-compute[72447]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1381244369</nova:name>
Jul 31 12:15:04 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:15:03</nova:creationTime>
Jul 31 12:15:04 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:15:04 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:15:04 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:15:04 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:15:04 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:15:04 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:15:04 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:15:04 user nova-compute[72447]:       <nova:owner>
Jul 31 12:15:04 user nova-compute[72447]:         <nova:user uuid="de2fa3b70ec747628afaf3c707e6d5ca">tempest-ServerStableDeviceRescueTest-1013716252-project-member</nova:user>
Jul 31 12:15:04 user nova-compute[72447]:         <nova:project uuid="139411ad75fe4bdf9e858f4260dfa1c9">tempest-ServerStableDeviceRescueTest-1013716252</nova:project>
Jul 31 12:15:04 user nova-compute[72447]:       </nova:owner>
Jul 31 12:15:04 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:15:04 user nova-compute[72447]:       <nova:ports>
Jul 31 12:15:04 user nova-compute[72447]:         <nova:port uuid="f276935a-5cfd-4a23-a87e-cbab33adf21e">
Jul 31 12:15:04 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 12:15:04 user nova-compute[72447]:         </nova:port>
Jul 31 12:15:04 user nova-compute[72447]:       </nova:ports>
Jul 31 12:15:04 user nova-compute[72447]:     </nova:instance>
Jul 31 12:15:04 user nova-compute[72447]:   </metadata>
Jul 31 12:15:04 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:15:04 user nova-compute[72447]:     <system>
Jul 31 12:15:04 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:15:04 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:15:04 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:15:04 user nova-compute[72447]:       <entry name="serial">87bc8e3c-6a96-4466-b6c0-390ba3f662a4</entry>
Jul 31 12:15:04 user nova-compute[72447]:       <entry name="uuid">87bc8e3c-6a96-4466-b6c0-390ba3f662a4</entry>
Jul 31 12:15:04 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:15:04 user nova-compute[72447]:     </system>
Jul 31 12:15:04 user nova-compute[72447]:   </sysinfo>
Jul 31 12:15:04 user nova-compute[72447]:   <os>
Jul 31 12:15:04 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:15:04 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:15:04 user nova-compute[72447]:   </os>
Jul 31 12:15:04 user nova-compute[72447]:   <features>
Jul 31 12:15:04 user nova-compute[72447]:     <acpi/>
Jul 31 12:15:04 user nova-compute[72447]:     <apic/>
Jul 31 12:15:04 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:15:04 user nova-compute[72447]:   </features>
Jul 31 12:15:04 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:15:04 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:15:04 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:15:04 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:15:04 user nova-compute[72447]:   </clock>
Jul 31 12:15:04 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:15:04 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:15:04 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:15:04 user nova-compute[72447]:   </cpu>
Jul 31 12:15:04 user nova-compute[72447]:   <devices>
Jul 31 12:15:04 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:15:04 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:15:04 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk"/>
Jul 31 12:15:04 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:15:04 user nova-compute[72447]:     </disk>
Jul 31 12:15:04 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:15:04 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:15:04 user nova-compute[72447]:       <source dev="/dev/sdb"/>
Jul 31 12:15:04 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:15:04 user nova-compute[72447]:       <serial>95e9db9e-2f16-4182-93fa-6e4e6c70b6e1</serial>
Jul 31 12:15:04 user nova-compute[72447]:     </disk>
Jul 31 12:15:04 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:15:04 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:15:04 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.rescue"/>
Jul 31 12:15:04 user nova-compute[72447]:       <target dev="vdc" bus="virtio"/>
Jul 31 12:15:04 user nova-compute[72447]:       <boot order="1"/>
Jul 31 12:15:04 user nova-compute[72447]:     </disk>
Jul 31 12:15:04 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:15:04 user nova-compute[72447]:       <mac address="fa:16:3e:d4:43:3e"/>
Jul 31 12:15:04 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:15:04 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:15:04 user nova-compute[72447]:       <target dev="tapf276935a-5c"/>
Jul 31 12:15:04 user nova-compute[72447]:     </interface>
Jul 31 12:15:04 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:15:04 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/console.log" append="off"/>
Jul 31 12:15:04 user nova-compute[72447]:     </serial>
Jul 31 12:15:04 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:15:04 user nova-compute[72447]:     <video>
Jul 31 12:15:04 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:15:04 user nova-compute[72447]:     </video>
Jul 31 12:15:04 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:15:04 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:15:04 user nova-compute[72447]:     </rng>
Jul 31 12:15:04 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:15:04 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:15:04 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:15:04 user nova-compute[72447]:     </memballoon>
Jul 31 12:15:04 user nova-compute[72447]:   </devices>
Jul 31 12:15:04 user nova-compute[72447]: </domain>
Jul 31 12:15:04 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:15:04 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Instance destroyed successfully.
Jul 31 12:15:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:15:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:15:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:15:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] No VIF found with MAC fa:16:3e:d4:43:3e, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:15:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-aae9e872-5e18-4727-8f74-6a238a8e6104 req-16216033-b7a0-4471-910a-24e824920962 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-aae9e872-5e18-4727-8f74-6a238a8e6104 req-16216033-b7a0-4471-910a-24e824920962 service nova] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-aae9e872-5e18-4727-8f74-6a238a8e6104 req-16216033-b7a0-4471-910a-24e824920962 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-aae9e872-5e18-4727-8f74-6a238a8e6104 req-16216033-b7a0-4471-910a-24e824920962 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-aae9e872-5e18-4727-8f74-6a238a8e6104 req-16216033-b7a0-4471-910a-24e824920962 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] No waiting events found dispatching network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:05 user nova-compute[72447]: WARNING nova.compute.manager [req-aae9e872-5e18-4727-8f74-6a238a8e6104 req-16216033-b7a0-4471-910a-24e824920962 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received unexpected event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e for instance with vm_state active and task_state rescuing.
Jul 31 12:15:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-c99b0315-09ce-4849-bb2b-04827afb538e req-7735a3ed-b426-445c-85f7-123528818c3f service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Received event network-changed-697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-c99b0315-09ce-4849-bb2b-04827afb538e req-7735a3ed-b426-445c-85f7-123528818c3f service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Refreshing instance network info cache due to event network-changed-697310a1-2921-4793-82f2-b5371e4d61e8. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c99b0315-09ce-4849-bb2b-04827afb538e req-7735a3ed-b426-445c-85f7-123528818c3f service nova] Acquiring lock "refresh_cache-10919978-d29f-42b7-b091-309d7202b6ce" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c99b0315-09ce-4849-bb2b-04827afb538e req-7735a3ed-b426-445c-85f7-123528818c3f service nova] Acquired lock "refresh_cache-10919978-d29f-42b7-b091-309d7202b6ce" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-c99b0315-09ce-4849-bb2b-04827afb538e req-7735a3ed-b426-445c-85f7-123528818c3f service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Refreshing network info cache for port 697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Successfully updated port: ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "refresh_cache-2f98bc8b-537a-4b34-85ce-d7baac240046" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquired lock "refresh_cache-2f98bc8b-537a-4b34-85ce-d7baac240046" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquired lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-c84b7d50-efeb-49ce-83de-94330fb9f035 req-4a90bfa0-f4a9-410f-b9c1-06a84a8826ae service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Received event network-changed-ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-c84b7d50-efeb-49ce-83de-94330fb9f035 req-4a90bfa0-f4a9-410f-b9c1-06a84a8826ae service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Refreshing instance network info cache due to event network-changed-ba08be19-41fe-4c05-8b70-b0b7a72760d2. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c84b7d50-efeb-49ce-83de-94330fb9f035 req-4a90bfa0-f4a9-410f-b9c1-06a84a8826ae service nova] Acquiring lock "refresh_cache-2f98bc8b-537a-4b34-85ce-d7baac240046" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Updating instance_info_cache with network_info: [{"id": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "address": "fa:16:3e:41:f6:dd", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba08be19-41", "ovs_interfaceid": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Releasing lock "refresh_cache-2f98bc8b-537a-4b34-85ce-d7baac240046" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.compute.manager [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Instance network_info: |[{"id": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "address": "fa:16:3e:41:f6:dd", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba08be19-41", "ovs_interfaceid": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c84b7d50-efeb-49ce-83de-94330fb9f035 req-4a90bfa0-f4a9-410f-b9c1-06a84a8826ae service nova] Acquired lock "refresh_cache-2f98bc8b-537a-4b34-85ce-d7baac240046" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-c84b7d50-efeb-49ce-83de-94330fb9f035 req-4a90bfa0-f4a9-410f-b9c1-06a84a8826ae service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Refreshing network info cache for port ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Start _get_guest_xml network_info=[{"id": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "address": "fa:16:3e:41:f6:dd", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba08be19-41", "ovs_interfaceid": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:15:06 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:15:06 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1809925763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1809925763',id=14,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs4w0d4M93O7HvFdCBFSNh6TCO6tKxxB39i+zx8AUMmhlsq736whk78TZS3wSeN4BOZU+/jx3ptUFkkipQu2dNk2OyJ5AoXdiQTEUSp9g4fvSyJ4EtilATHuuSom8hCcQ==',key_name='tempest-keypair-2092305748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fefc91464b24c68a6d7f9059ec58b5f',ramdisk_id='',reservation_id='r-cv2isjq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1359270950',owner_user_name='tempest-ServerActionsV293TestJSON-1359270950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:15:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855a22b65634f1690901a5f9be8e885',uuid=2f98bc8b-537a-4b34-85ce-d7baac240046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "address": "fa:16:3e:41:f6:dd", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba08be19-41", "ovs_interfaceid": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converting VIF {"id": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "address": "fa:16:3e:41:f6:dd", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba08be19-41", "ovs_interfaceid": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba08be19-41fe-4c05-8b70-b0b7a72760d2,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba08be19-41') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.objects.instance [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f98bc8b-537a-4b34-85ce-d7baac240046 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "10919978-d29f-42b7-b091-309d7202b6ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "10919978-d29f-42b7-b091-309d7202b6ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "10919978-d29f-42b7-b091-309d7202b6ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "10919978-d29f-42b7-b091-309d7202b6ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "10919978-d29f-42b7-b091-309d7202b6ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:15:06 user nova-compute[72447]:   <uuid>2f98bc8b-537a-4b34-85ce-d7baac240046</uuid>
Jul 31 12:15:06 user nova-compute[72447]:   <name>instance-0000000e</name>
Jul 31 12:15:06 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:15:06 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:15:06 user nova-compute[72447]:   <metadata>
Jul 31 12:15:06 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:15:06 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:15:06 user nova-compute[72447]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1809925763</nova:name>
Jul 31 12:15:06 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:15:06</nova:creationTime>
Jul 31 12:15:06 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:15:06 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:15:06 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:15:06 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:15:06 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:15:06 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:15:06 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:15:06 user nova-compute[72447]:       <nova:owner>
Jul 31 12:15:06 user nova-compute[72447]:         <nova:user uuid="0855a22b65634f1690901a5f9be8e885">tempest-ServerActionsV293TestJSON-1359270950-project-member</nova:user>
Jul 31 12:15:06 user nova-compute[72447]:         <nova:project uuid="5fefc91464b24c68a6d7f9059ec58b5f">tempest-ServerActionsV293TestJSON-1359270950</nova:project>
Jul 31 12:15:06 user nova-compute[72447]:       </nova:owner>
Jul 31 12:15:06 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:15:06 user nova-compute[72447]:       <nova:ports>
Jul 31 12:15:06 user nova-compute[72447]:         <nova:port uuid="ba08be19-41fe-4c05-8b70-b0b7a72760d2">
Jul 31 12:15:06 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:15:06 user nova-compute[72447]:         </nova:port>
Jul 31 12:15:06 user nova-compute[72447]:       </nova:ports>
Jul 31 12:15:06 user nova-compute[72447]:     </nova:instance>
Jul 31 12:15:06 user nova-compute[72447]:   </metadata>
Jul 31 12:15:06 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:15:06 user nova-compute[72447]:     <system>
Jul 31 12:15:06 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:15:06 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:15:06 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:15:06 user nova-compute[72447]:       <entry name="serial">2f98bc8b-537a-4b34-85ce-d7baac240046</entry>
Jul 31 12:15:06 user nova-compute[72447]:       <entry name="uuid">2f98bc8b-537a-4b34-85ce-d7baac240046</entry>
Jul 31 12:15:06 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:15:06 user nova-compute[72447]:     </system>
Jul 31 12:15:06 user nova-compute[72447]:   </sysinfo>
Jul 31 12:15:06 user nova-compute[72447]:   <os>
Jul 31 12:15:06 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:15:06 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:15:06 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:15:06 user nova-compute[72447]:   </os>
Jul 31 12:15:06 user nova-compute[72447]:   <features>
Jul 31 12:15:06 user nova-compute[72447]:     <acpi/>
Jul 31 12:15:06 user nova-compute[72447]:     <apic/>
Jul 31 12:15:06 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:15:06 user nova-compute[72447]:   </features>
Jul 31 12:15:06 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:15:06 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:15:06 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:15:06 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:15:06 user nova-compute[72447]:   </clock>
Jul 31 12:15:06 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:15:06 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:15:06 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:15:06 user nova-compute[72447]:   </cpu>
Jul 31 12:15:06 user nova-compute[72447]:   <devices>
Jul 31 12:15:06 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:15:06 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:15:06 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk"/>
Jul 31 12:15:06 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:15:06 user nova-compute[72447]:     </disk>
Jul 31 12:15:06 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:15:06 user nova-compute[72447]:       <mac address="fa:16:3e:41:f6:dd"/>
Jul 31 12:15:06 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:15:06 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:15:06 user nova-compute[72447]:       <target dev="tapba08be19-41"/>
Jul 31 12:15:06 user nova-compute[72447]:     </interface>
Jul 31 12:15:06 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:15:06 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/console.log" append="off"/>
Jul 31 12:15:06 user nova-compute[72447]:     </serial>
Jul 31 12:15:06 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:15:06 user nova-compute[72447]:     <video>
Jul 31 12:15:06 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:15:06 user nova-compute[72447]:     </video>
Jul 31 12:15:06 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:15:06 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:15:06 user nova-compute[72447]:     </rng>
Jul 31 12:15:06 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:15:06 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:15:06 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:15:06 user nova-compute[72447]:     </memballoon>
Jul 31 12:15:06 user nova-compute[72447]:   </devices>
Jul 31 12:15:06 user nova-compute[72447]: </domain>
Jul 31 12:15:06 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1809925763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1809925763',id=14,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs4w0d4M93O7HvFdCBFSNh6TCO6tKxxB39i+zx8AUMmhlsq736whk78TZS3wSeN4BOZU+/jx3ptUFkkipQu2dNk2OyJ5AoXdiQTEUSp9g4fvSyJ4EtilATHuuSom8hCcQ==',key_name='tempest-keypair-2092305748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fefc91464b24c68a6d7f9059ec58b5f',ramdisk_id='',reservation_id='r-cv2isjq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1359270950',owner_user_name='tempest-ServerActionsV293TestJSON-1359270950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:15:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855a22b65634f1690901a5f9be8e885',uuid=2f98bc8b-537a-4b34-85ce-d7baac240046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "address": "fa:16:3e:41:f6:dd", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba08be19-41", "ovs_interfaceid": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converting VIF {"id": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "address": "fa:16:3e:41:f6:dd", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba08be19-41", "ovs_interfaceid": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba08be19-41fe-4c05-8b70-b0b7a72760d2,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba08be19-41') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG os_vif [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba08be19-41fe-4c05-8b70-b0b7a72760d2,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba08be19-41') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:15:06 user nova-compute[72447]: INFO nova.compute.manager [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Terminating instance
Jul 31 12:15:06 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba08be19-41, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba08be19-41, col_values=(('external_ids', {'iface-id': 'ba08be19-41fe-4c05-8b70-b0b7a72760d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:f6:dd', 'vm-uuid': '2f98bc8b-537a-4b34-85ce-d7baac240046'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:15:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:06 user nova-compute[72447]: INFO os_vif [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba08be19-41fe-4c05-8b70-b0b7a72760d2,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba08be19-41')
Jul 31 12:15:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] No VIF found with MAC fa:16:3e:41:f6:dd, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG nova.network.neutron [req-c84b7d50-efeb-49ce-83de-94330fb9f035 req-4a90bfa0-f4a9-410f-b9c1-06a84a8826ae service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Updated VIF entry in instance network info cache for port ba08be19-41fe-4c05-8b70-b0b7a72760d2. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG nova.network.neutron [req-c84b7d50-efeb-49ce-83de-94330fb9f035 req-4a90bfa0-f4a9-410f-b9c1-06a84a8826ae service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Updating instance_info_cache with network_info: [{"id": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "address": "fa:16:3e:41:f6:dd", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba08be19-41", "ovs_interfaceid": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c84b7d50-efeb-49ce-83de-94330fb9f035 req-4a90bfa0-f4a9-410f-b9c1-06a84a8826ae service nova] Releasing lock "refresh_cache-2f98bc8b-537a-4b34-85ce-d7baac240046" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG nova.network.neutron [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updating instance_info_cache with network_info: [{"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Releasing lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:15:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Creating image(s)
Jul 31 12:15:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "/opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "/opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG nova.objects.instance [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG nova.network.neutron [req-c99b0315-09ce-4849-bb2b-04827afb538e req-7735a3ed-b426-445c-85f7-123528818c3f service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Updated VIF entry in instance network info cache for port 697310a1-2921-4793-82f2-b5371e4d61e8. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG nova.network.neutron [req-c99b0315-09ce-4849-bb2b-04827afb538e req-7735a3ed-b426-445c-85f7-123528818c3f service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Updating instance_info_cache with network_info: [{"id": "697310a1-2921-4793-82f2-b5371e4d61e8", "address": "fa:16:3e:bc:85:df", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697310a1-29", "ovs_interfaceid": "697310a1-2921-4793-82f2-b5371e4d61e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "9c2e1053c2d73a50b0408acc2842a2fc3380214e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "9c2e1053c2d73a50b0408acc2842a2fc3380214e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c99b0315-09ce-4849-bb2b-04827afb538e req-7735a3ed-b426-445c-85f7-123528818c3f service nova] Releasing lock "refresh_cache-10919978-d29f-42b7-b091-309d7202b6ce" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-593b6bab-3ab6-4b08-a1cc-031b89fb2448 req-61d5a373-f68a-4018-a78d-a9cf063a9353 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-593b6bab-3ab6-4b08-a1cc-031b89fb2448 req-61d5a373-f68a-4018-a78d-a9cf063a9353 service nova] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-593b6bab-3ab6-4b08-a1cc-031b89fb2448 req-61d5a373-f68a-4018-a78d-a9cf063a9353 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-593b6bab-3ab6-4b08-a1cc-031b89fb2448 req-61d5a373-f68a-4018-a78d-a9cf063a9353 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-593b6bab-3ab6-4b08-a1cc-031b89fb2448 req-61d5a373-f68a-4018-a78d-a9cf063a9353 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] No waiting events found dispatching network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:07 user nova-compute[72447]: WARNING nova.compute.manager [req-593b6bab-3ab6-4b08-a1cc-031b89fb2448 req-61d5a373-f68a-4018-a78d-a9cf063a9353 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received unexpected event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e for instance with vm_state active and task_state rescuing.
Jul 31 12:15:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e.part --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-changed-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Refreshing instance network info cache due to event network-changed-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] Acquiring lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] Acquired lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.network.neutron [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Refreshing network info cache for port c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805708.0046797, 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:15:09 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] VM Resumed (Lifecycle Event)
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-8b5e8be0-d47e-4a53-8391-09d486dc5571 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:09 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Instance destroyed successfully.
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'resources' on Instance uuid 10919978-d29f-42b7-b091-309d7202b6ce {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1105524451',display_name='tempest-AttachVolumeNegativeTest-server-1105524451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1105524451',id=13,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK54uqhtDVYUnyn5Tg6n0ZX5zxyT0H96D2HvAxDHq4OXU+g3rXAsOoCW2bEYboOnDPtyeEPlhH8IJrEbA/qshjJY+q/Jd4KB7UqE30FJilAchrUA8SsR3wvNyVgY6xVDew==',key_name='tempest-keypair-1089878780',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:13:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fad40b5f5e54e7ab9c6f8e78ceb3947',ramdisk_id='',reservation_id='r-dm79r8b1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-323727931',owner_user_name='tempest-AttachVolumeNegativeTest-323727931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a7feffde0f74f63a6bd027c1958aacb',uuid=10919978-d29f-42b7-b091-309d7202b6ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "697310a1-2921-4793-82f2-b5371e4d61e8", "address": "fa:16:3e:bc:85:df", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697310a1-29", "ovs_interfaceid": "697310a1-2921-4793-82f2-b5371e4d61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converting VIF {"id": "697310a1-2921-4793-82f2-b5371e4d61e8", "address": "fa:16:3e:bc:85:df", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697310a1-29", "ovs_interfaceid": "697310a1-2921-4793-82f2-b5371e4d61e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:85:df,bridge_name='br-int',has_traffic_filtering=True,id=697310a1-2921-4793-82f2-b5371e4d61e8,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697310a1-29') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG os_vif [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:85:df,bridge_name='br-int',has_traffic_filtering=True,id=697310a1-2921-4793-82f2-b5371e4d61e8,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697310a1-29') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap697310a1-29, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:15:09 user nova-compute[72447]: INFO os_vif [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:85:df,bridge_name='br-int',has_traffic_filtering=True,id=697310a1-2921-4793-82f2-b5371e4d61e8,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697310a1-29')
Jul 31 12:15:09 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Deleting instance files /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce_del
Jul 31 12:15:09 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Deletion of /opt/stack/data/nova/instances/10919978-d29f-42b7-b091-309d7202b6ce_del complete
Jul 31 12:15:09 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805708.0061996, 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:15:09 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] VM Started (Lifecycle Event)
Jul 31 12:15:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e.part --force-share --output=json" returned: 0 in 0.202s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.virt.images [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] 84b867b2-9d98-40c4-a8db-7bbf5024f4ff was qcow2, converting to raw {{(pid=72447) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e.part /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e.converted {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:15:09 user nova-compute[72447]: INFO nova.compute.manager [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Took 2.65 seconds to destroy the instance on the hypervisor.
Jul 31 12:15:09 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-6a0387bc-ee79-4145-86a2-cb3382078c7a req-9817d3ee-c3bd-4679-add4-75c8b73c2ed8 service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Received event network-vif-plugged-ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6a0387bc-ee79-4145-86a2-cb3382078c7a req-9817d3ee-c3bd-4679-add4-75c8b73c2ed8 service nova] Acquiring lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6a0387bc-ee79-4145-86a2-cb3382078c7a req-9817d3ee-c3bd-4679-add4-75c8b73c2ed8 service nova] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6a0387bc-ee79-4145-86a2-cb3382078c7a req-9817d3ee-c3bd-4679-add4-75c8b73c2ed8 service nova] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-6a0387bc-ee79-4145-86a2-cb3382078c7a req-9817d3ee-c3bd-4679-add4-75c8b73c2ed8 service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] No waiting events found dispatching network-vif-plugged-ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:09 user nova-compute[72447]: WARNING nova.compute.manager [req-6a0387bc-ee79-4145-86a2-cb3382078c7a req-9817d3ee-c3bd-4679-add4-75c8b73c2ed8 service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Received unexpected event network-vif-plugged-ba08be19-41fe-4c05-8b70-b0b7a72760d2 for instance with vm_state building and task_state spawning.
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e.part /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e.converted" returned: 0 in 0.672s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e.converted --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "9c2e1053c2d73a50b0408acc2842a2fc3380214e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.501s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG nova.network.neutron [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updated VIF entry in instance network info cache for port c9c41aee-bb54-4d97-8f69-9dd65e2c97b7. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG nova.network.neutron [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updating instance_info_cache with network_info: [{"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e --force-share --output=json" returned: 0 in 0.170s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "9c2e1053c2d73a50b0408acc2842a2fc3380214e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "9c2e1053c2d73a50b0408acc2842a2fc3380214e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] Releasing lock "refresh_cache-6c701045-e520-421f-94d2-b54edd0d5c54" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Received event network-vif-unplugged-697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] Acquiring lock "10919978-d29f-42b7-b091-309d7202b6ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] Lock "10919978-d29f-42b7-b091-309d7202b6ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] Lock "10919978-d29f-42b7-b091-309d7202b6ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] No waiting events found dispatching network-vif-unplugged-697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Received event network-vif-unplugged-697310a1-2921-4793-82f2-b5371e4d61e8 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Received event network-vif-plugged-697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] Acquiring lock "10919978-d29f-42b7-b091-309d7202b6ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] Lock "10919978-d29f-42b7-b091-309d7202b6ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] Lock "10919978-d29f-42b7-b091-309d7202b6ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] No waiting events found dispatching network-vif-plugged-697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:10 user nova-compute[72447]: WARNING nova.compute.manager [req-80b09e10-c099-4de1-9326-03ed5b8a27ae req-e74ef145-4e42-46b8-b2db-d63a080f4e5b service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Received unexpected event network-vif-plugged-697310a1-2921-4793-82f2-b5371e4d61e8 for instance with vm_state active and task_state deleting.
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e --force-share --output=json" returned: 0 in 0.157s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e,backing_fmt=raw /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e,backing_fmt=raw /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk 1073741824" returned: 0 in 0.079s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "9c2e1053c2d73a50b0408acc2842a2fc3380214e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805695.973492, b2cab306-7667-47cf-a689-75ad6d6b5dc3 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:15:10 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] VM Stopped (Lifecycle Event)
Jul 31 12:15:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e --force-share --output=json" returned: 0 in 0.223s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:10 user nova-compute[72447]: DEBUG nova.objects.instance [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'migration_context' on Instance uuid 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-481bc846-fd92-429f-bfc6-cd353e505b76 None None] [instance: b2cab306-7667-47cf-a689-75ad6d6b5dc3] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:11 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Rebasing disk image.
Jul 31 12:15:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.215s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c -F raw /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:11 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:15:11 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Took 1.99 seconds to deallocate network for instance.
Jul 31 12:15:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-c23f6585-dc0f-42fd-9ce1-0d042d547021 req-7d48fb06-b627-4568-94b1-ddf2bcd97f1a service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Received event network-vif-deleted-697310a1-2921-4793-82f2-b5371e4d61e8 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:11 user nova-compute[72447]: INFO nova.compute.manager [req-c23f6585-dc0f-42fd-9ce1-0d042d547021 req-7d48fb06-b627-4568-94b1-ddf2bcd97f1a service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Neutron deleted interface 697310a1-2921-4793-82f2-b5371e4d61e8; detaching it from the instance and deleting it from the info cache
Jul 31 12:15:11 user nova-compute[72447]: DEBUG nova.network.neutron [req-c23f6585-dc0f-42fd-9ce1-0d042d547021 req-7d48fb06-b627-4568-94b1-ddf2bcd97f1a service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:15:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-c23f6585-dc0f-42fd-9ce1-0d042d547021 req-7d48fb06-b627-4568-94b1-ddf2bcd97f1a service nova] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Detach interface failed, port_id=697310a1-2921-4793-82f2-b5371e4d61e8, reason: Instance 10919978-d29f-42b7-b091-309d7202b6ce could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:15:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-39edb1c6-56bf-41c1-92f1-c2534054e9ab req-326b75c9-1f21-4e9b-9613-0fff20b4c51a service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Received event network-vif-plugged-ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-39edb1c6-56bf-41c1-92f1-c2534054e9ab req-326b75c9-1f21-4e9b-9613-0fff20b4c51a service nova] Acquiring lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-39edb1c6-56bf-41c1-92f1-c2534054e9ab req-326b75c9-1f21-4e9b-9613-0fff20b4c51a service nova] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-39edb1c6-56bf-41c1-92f1-c2534054e9ab req-326b75c9-1f21-4e9b-9613-0fff20b4c51a service nova] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-39edb1c6-56bf-41c1-92f1-c2534054e9ab req-326b75c9-1f21-4e9b-9613-0fff20b4c51a service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] No waiting events found dispatching network-vif-plugged-ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:11 user nova-compute[72447]: WARNING nova.compute.manager [req-39edb1c6-56bf-41c1-92f1-c2534054e9ab req-326b75c9-1f21-4e9b-9613-0fff20b4c51a service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Received unexpected event network-vif-plugged-ba08be19-41fe-4c05-8b70-b0b7a72760d2 for instance with vm_state building and task_state spawning.
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.549s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805712.2847536, 2f98bc8b-537a-4b34-85ce-d7baac240046 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:15:12 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] VM Resumed (Lifecycle Event)
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:15:12 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Instance spawned successfully.
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:15:12 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Deleted allocations for instance 10919978-d29f-42b7-b091-309d7202b6ce
Jul 31 12:15:12 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805712.2863932, 2f98bc8b-537a-4b34-85ce-d7baac240046 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:15:12 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] VM Started (Lifecycle Event)
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:15:12 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:15:12 user nova-compute[72447]: INFO nova.compute.manager [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Took 10.85 seconds to spawn the instance on the hypervisor.
Jul 31 12:15:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6b9ad60d-f1ad-4248-9a01-e9657257630e tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "10919978-d29f-42b7-b091-309d7202b6ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.531s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:12 user nova-compute[72447]: INFO nova.compute.manager [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Took 11.76 seconds to build instance.
Jul 31 12:15:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-96d00786-5c54-43c2-a981-de4c96e9f329 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.921s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c -F raw /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk" returned: 0 in 2.828s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Ensure instance console log exists: /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Start _get_guest_xml network_info=[{"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c5a8e6be33f1c984789473ae49dbe1c1',container_format='bare',created_at=2023-07-31T12:12:58Z,direct_url=<?>,disk_format='qcow2',id=84b867b2-9d98-40c4-a8db-7bbf5024f4ff,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-15178390-shelved',owner='8b8dd0d543cb4786afc39e88f440e538',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '404132ac-9969-439e-8825-0e85bf1eba8c', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxHFNDwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '6c701045-e520-421f-94d2-b54edd0d5c54', 'attached_at': '', 'detached_at': '', 'volume_id': '05147714-4486-4123-b02d-acff59beea1f', 'serial': '05147714-4486-4123-b02d-acff59beea1f'}, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:15:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:15:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c5a8e6be33f1c984789473ae49dbe1c1',container_format='bare',created_at=2023-07-31T12:12:58Z,direct_url=<?>,disk_format='qcow2',id=84b867b2-9d98-40c4-a8db-7bbf5024f4ff,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-15178390-shelved',owner='8b8dd0d543cb4786afc39e88f440e538',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.objects.instance [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxHFNDwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:15:14 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:15:14 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:15:14 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[144e7a87-ca86-42c6-b731-38ebf6c54d16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:15:14 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a2e72c-7a12-4968-9cd0-47126260854e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f] added
Jul 31 12:15:14 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c30f94-45fd-441a-aa9b-fedd3f571d78]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a5d2d6-2870-4198-942f-af3a5ae246c7]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxHFNDwI {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxHFNDwI" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd3072b-21de-4aee-a43a-3b2c69336729]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jxHFNDwI'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e064654c-247b-4e20-8c00-6e5e08dd0541]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b7fc01-1621-46b7-970a-b375bd154e45]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:15:14 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:15:14 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:15:14 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:15:14 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:15:14 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:15:14 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[385e6064-5171-4127-911f-07fac51e549b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f, portal: 172.16.0.220,3260]
Jul 31 12:15:14 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f, portal: 172.16.0.220,3260] successful.
Jul 31 12:15:14 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb4a9a8-566b-405b-a85f-cd1948c08be8]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d3a40c-7786-408a-b666-cc0a25dacc5e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:15:14 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:15:14 user nova-compute[72447]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f (non-flash)
Jul 31 12:15:14 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:15:14 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:15:14 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:15:14 user nova-compute[72447]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f (non-flash)
Jul 31 12:15:14 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:15:14 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.033s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[045b15e4-94a9-47b2-a94f-6033c737739e]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:15:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxHFNDwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23034633338306437', 'path': '/dev/sdc'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034633338306437', 'path': '/dev/sdc'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-15178390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-15178390',id=4,image_ref='84b867b2-9d98-40c4-a8db-7bbf5024f4ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2138130535',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8b8dd0d543cb4786afc39e88f440e538',ramdisk_id='',reservation_id='r-e7ubc06s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1971436108',owner_user_name='tempest-AttachVolumeShelveTestJSON-1971436108-project-member',shelved_at='2023-07-31T12:13:04.415514',shelved_host='user',shelved_image_id='84b867b2-9d98-40c4-a8db-7bbf5024f4ff'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc465160a3a94498ab1aa3aa44280b12',uuid=6c701045-e520-421f-94d2-b54edd0d5c54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converting VIF {"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG nova.objects.instance [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:15:15 user nova-compute[72447]:   <uuid>6c701045-e520-421f-94d2-b54edd0d5c54</uuid>
Jul 31 12:15:15 user nova-compute[72447]:   <name>instance-00000004</name>
Jul 31 12:15:15 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:15:15 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:15:15 user nova-compute[72447]:   <metadata>
Jul 31 12:15:15 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:15:15 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:15:15 user nova-compute[72447]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-15178390</nova:name>
Jul 31 12:15:15 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:15:14</nova:creationTime>
Jul 31 12:15:15 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:15:15 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:15:15 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:15:15 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:15:15 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:15:15 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:15:15 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:15:15 user nova-compute[72447]:       <nova:owner>
Jul 31 12:15:15 user nova-compute[72447]:         <nova:user uuid="cc465160a3a94498ab1aa3aa44280b12">tempest-AttachVolumeShelveTestJSON-1971436108-project-member</nova:user>
Jul 31 12:15:15 user nova-compute[72447]:         <nova:project uuid="8b8dd0d543cb4786afc39e88f440e538">tempest-AttachVolumeShelveTestJSON-1971436108</nova:project>
Jul 31 12:15:15 user nova-compute[72447]:       </nova:owner>
Jul 31 12:15:15 user nova-compute[72447]:       <nova:root type="image" uuid="84b867b2-9d98-40c4-a8db-7bbf5024f4ff"/>
Jul 31 12:15:15 user nova-compute[72447]:       <nova:ports>
Jul 31 12:15:15 user nova-compute[72447]:         <nova:port uuid="c9c41aee-bb54-4d97-8f69-9dd65e2c97b7">
Jul 31 12:15:15 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 12:15:15 user nova-compute[72447]:         </nova:port>
Jul 31 12:15:15 user nova-compute[72447]:       </nova:ports>
Jul 31 12:15:15 user nova-compute[72447]:     </nova:instance>
Jul 31 12:15:15 user nova-compute[72447]:   </metadata>
Jul 31 12:15:15 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:15:15 user nova-compute[72447]:     <system>
Jul 31 12:15:15 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:15:15 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:15:15 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:15:15 user nova-compute[72447]:       <entry name="serial">6c701045-e520-421f-94d2-b54edd0d5c54</entry>
Jul 31 12:15:15 user nova-compute[72447]:       <entry name="uuid">6c701045-e520-421f-94d2-b54edd0d5c54</entry>
Jul 31 12:15:15 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:15:15 user nova-compute[72447]:     </system>
Jul 31 12:15:15 user nova-compute[72447]:   </sysinfo>
Jul 31 12:15:15 user nova-compute[72447]:   <os>
Jul 31 12:15:15 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:15:15 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:15:15 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:15:15 user nova-compute[72447]:   </os>
Jul 31 12:15:15 user nova-compute[72447]:   <features>
Jul 31 12:15:15 user nova-compute[72447]:     <acpi/>
Jul 31 12:15:15 user nova-compute[72447]:     <apic/>
Jul 31 12:15:15 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:15:15 user nova-compute[72447]:   </features>
Jul 31 12:15:15 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:15:15 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:15:15 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:15:15 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:15:15 user nova-compute[72447]:   </clock>
Jul 31 12:15:15 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:15:15 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:15:15 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:15:15 user nova-compute[72447]:   </cpu>
Jul 31 12:15:15 user nova-compute[72447]:   <devices>
Jul 31 12:15:15 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:15:15 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:15:15 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk"/>
Jul 31 12:15:15 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:15:15 user nova-compute[72447]:     </disk>
Jul 31 12:15:15 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:15:15 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:15:15 user nova-compute[72447]:       <source dev="/dev/sdc"/>
Jul 31 12:15:15 user nova-compute[72447]:       <target dev="vdc" bus="virtio"/>
Jul 31 12:15:15 user nova-compute[72447]:       <serial>05147714-4486-4123-b02d-acff59beea1f</serial>
Jul 31 12:15:15 user nova-compute[72447]:     </disk>
Jul 31 12:15:15 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:15:15 user nova-compute[72447]:       <mac address="fa:16:3e:71:0e:50"/>
Jul 31 12:15:15 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:15:15 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:15:15 user nova-compute[72447]:       <target dev="tapc9c41aee-bb"/>
Jul 31 12:15:15 user nova-compute[72447]:     </interface>
Jul 31 12:15:15 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:15:15 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/console.log" append="off"/>
Jul 31 12:15:15 user nova-compute[72447]:     </serial>
Jul 31 12:15:15 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:15:15 user nova-compute[72447]:     <video>
Jul 31 12:15:15 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:15:15 user nova-compute[72447]:     </video>
Jul 31 12:15:15 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:15:15 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:15:15 user nova-compute[72447]:     </rng>
Jul 31 12:15:15 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:15:15 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:15:15 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:15:15 user nova-compute[72447]:     </memballoon>
Jul 31 12:15:15 user nova-compute[72447]:   </devices>
Jul 31 12:15:15 user nova-compute[72447]: </domain>
Jul 31 12:15:15 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-15178390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-15178390',id=4,image_ref='84b867b2-9d98-40c4-a8db-7bbf5024f4ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2138130535',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8b8dd0d543cb4786afc39e88f440e538',ramdisk_id='',reservation_id='r-e7ubc06s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1971436108',owner_user_name='tempest-AttachVolumeShelveTestJSON-1971436108-project-member',shelved_at='2023-07-31T12:13:04.415514',shelved_host='user',shelved_image_id='84b867b2-9d98-40c4-a8db-7bbf5024f4ff'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc465160a3a94498ab1aa3aa44280b12',uuid=6c701045-e520-421f-94d2-b54edd0d5c54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converting VIF {"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG os_vif [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9c41aee-bb, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9c41aee-bb, col_values=(('external_ids', {'iface-id': 'c9c41aee-bb54-4d97-8f69-9dd65e2c97b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:0e:50', 'vm-uuid': '6c701045-e520-421f-94d2-b54edd0d5c54'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:15 user nova-compute[72447]: INFO os_vif [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb')
Jul 31 12:15:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:15:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] No VIF found with MAC fa:16:3e:71:0e:50, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:15:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-42aea237-bb5e-4a00-8500-9190d091358a req-d6481324-b068-4652-b56b-f9f1d20d2e0f service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-42aea237-bb5e-4a00-8500-9190d091358a req-d6481324-b068-4652-b56b-f9f1d20d2e0f service nova] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-42aea237-bb5e-4a00-8500-9190d091358a req-d6481324-b068-4652-b56b-f9f1d20d2e0f service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-42aea237-bb5e-4a00-8500-9190d091358a req-d6481324-b068-4652-b56b-f9f1d20d2e0f service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-42aea237-bb5e-4a00-8500-9190d091358a req-d6481324-b068-4652-b56b-f9f1d20d2e0f service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] No waiting events found dispatching network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:17 user nova-compute[72447]: WARNING nova.compute.manager [req-42aea237-bb5e-4a00-8500-9190d091358a req-d6481324-b068-4652-b56b-f9f1d20d2e0f service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received unexpected event network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 12:15:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-6cc14bbc-e044-4882-9688-04ec502acba0 req-625601f7-696d-4bfc-a369-c4452ad18624 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6cc14bbc-e044-4882-9688-04ec502acba0 req-625601f7-696d-4bfc-a369-c4452ad18624 service nova] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6cc14bbc-e044-4882-9688-04ec502acba0 req-625601f7-696d-4bfc-a369-c4452ad18624 service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6cc14bbc-e044-4882-9688-04ec502acba0 req-625601f7-696d-4bfc-a369-c4452ad18624 service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-6cc14bbc-e044-4882-9688-04ec502acba0 req-625601f7-696d-4bfc-a369-c4452ad18624 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] No waiting events found dispatching network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:19 user nova-compute[72447]: WARNING nova.compute.manager [req-6cc14bbc-e044-4882-9688-04ec502acba0 req-625601f7-696d-4bfc-a369-c4452ad18624 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received unexpected event network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 12:15:20 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805720.1423554, 6c701045-e520-421f-94d2-b54edd0d5c54 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:15:20 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] VM Resumed (Lifecycle Event)
Jul 31 12:15:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:15:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:15:20 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Instance spawned successfully.
Jul 31 12:15:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:15:20 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:15:20 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805720.1432126, 6c701045-e520-421f-94d2-b54edd0d5c54 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:15:20 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] VM Started (Lifecycle Event)
Jul 31 12:15:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:15:20 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:15:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-51923bcb-a6af-48e4-bb7c-4df5a2e6fee7 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "6c701045-e520-421f-94d2-b54edd0d5c54" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.962s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:24 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805709.1276495, 10919978-d29f-42b7-b091-309d7202b6ce => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:15:24 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] VM Stopped (Lifecycle Event)
Jul 31 12:15:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d9f22394-5274-4429-bcb8-66d358efaae6 None None] [instance: 10919978-d29f-42b7-b091-309d7202b6ce] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:40 user nova-compute[72447]: INFO nova.compute.manager [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Rescuing
Jul 31 12:15:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:15:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquired lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:15:40 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:15:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:41 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updating instance_info_cache with network_info: [{"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:15:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Releasing lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:15:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-a6f2ff3d-1593-427a-a989-1015a2146f98 req-837c8261-434b-482a-ad16-218a7b903f62 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-unplugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a6f2ff3d-1593-427a-a989-1015a2146f98 req-837c8261-434b-482a-ad16-218a7b903f62 service nova] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a6f2ff3d-1593-427a-a989-1015a2146f98 req-837c8261-434b-482a-ad16-218a7b903f62 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a6f2ff3d-1593-427a-a989-1015a2146f98 req-837c8261-434b-482a-ad16-218a7b903f62 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-a6f2ff3d-1593-427a-a989-1015a2146f98 req-837c8261-434b-482a-ad16-218a7b903f62 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] No waiting events found dispatching network-vif-unplugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:42 user nova-compute[72447]: WARNING nova.compute.manager [req-a6f2ff3d-1593-427a-a989-1015a2146f98 req-837c8261-434b-482a-ad16-218a7b903f62 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received unexpected event network-vif-unplugged-845d0677-fdf6-4de9-abc7-243080eeae50 for instance with vm_state active and task_state rescuing.
Jul 31 12:15:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:42 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Instance destroyed successfully.
Jul 31 12:15:42 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Attempting rescue
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72447) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Instance directory exists: not creating {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 12:15:42 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Creating image(s)
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "/opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "/opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "/opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'trusted_certs' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.159s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.rescue {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.rescue" returned: 0 in 0.054s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'migration_context' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Start _get_guest_xml network_info=[{"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "vif_mac": "fa:16:3e:cf:66:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'resources' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'numa_topology' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:42 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:15:42 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'vcpu_model' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2031996339',display_name='tempest-ServerRescueNegativeTestJSON-server-2031996339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2031996339',id=1,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9576e1abb5b1475da061ca824d7c3788',ramdisk_id='',reservation_id='r-dmkw01xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2103641702',owner_user_name='tempest-ServerRescueNegativeTestJSON-2103641702-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:11:08Z,user_data=None,user_id='cbcdd571b45b4450a8b27b834a05a2b6',uuid=981b694a-bf63-4f4b-95c5-bc17aa72b87b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "vif_mac": "fa:16:3e:cf:66:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converting VIF {"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "vif_mac": "fa:16:3e:cf:66:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:66:ee,bridge_name='br-int',has_traffic_filtering=True,id=845d0677-fdf6-4de9-abc7-243080eeae50,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845d0677-fd') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'pci_devices' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:15:42 user nova-compute[72447]:   <uuid>981b694a-bf63-4f4b-95c5-bc17aa72b87b</uuid>
Jul 31 12:15:42 user nova-compute[72447]:   <name>instance-00000001</name>
Jul 31 12:15:42 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:15:42 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:15:42 user nova-compute[72447]:   <metadata>
Jul 31 12:15:42 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:15:42 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:15:42 user nova-compute[72447]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2031996339</nova:name>
Jul 31 12:15:42 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:15:42</nova:creationTime>
Jul 31 12:15:42 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:15:42 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:15:42 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:15:42 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:15:42 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:15:42 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:15:42 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:15:42 user nova-compute[72447]:       <nova:owner>
Jul 31 12:15:42 user nova-compute[72447]:         <nova:user uuid="cbcdd571b45b4450a8b27b834a05a2b6">tempest-ServerRescueNegativeTestJSON-2103641702-project-member</nova:user>
Jul 31 12:15:42 user nova-compute[72447]:         <nova:project uuid="9576e1abb5b1475da061ca824d7c3788">tempest-ServerRescueNegativeTestJSON-2103641702</nova:project>
Jul 31 12:15:42 user nova-compute[72447]:       </nova:owner>
Jul 31 12:15:42 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:15:42 user nova-compute[72447]:       <nova:ports>
Jul 31 12:15:42 user nova-compute[72447]:         <nova:port uuid="845d0677-fdf6-4de9-abc7-243080eeae50">
Jul 31 12:15:42 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 12:15:42 user nova-compute[72447]:         </nova:port>
Jul 31 12:15:42 user nova-compute[72447]:       </nova:ports>
Jul 31 12:15:42 user nova-compute[72447]:     </nova:instance>
Jul 31 12:15:42 user nova-compute[72447]:   </metadata>
Jul 31 12:15:42 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:15:42 user nova-compute[72447]:     <system>
Jul 31 12:15:42 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:15:42 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:15:42 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:15:42 user nova-compute[72447]:       <entry name="serial">981b694a-bf63-4f4b-95c5-bc17aa72b87b</entry>
Jul 31 12:15:42 user nova-compute[72447]:       <entry name="uuid">981b694a-bf63-4f4b-95c5-bc17aa72b87b</entry>
Jul 31 12:15:42 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:15:42 user nova-compute[72447]:     </system>
Jul 31 12:15:42 user nova-compute[72447]:   </sysinfo>
Jul 31 12:15:42 user nova-compute[72447]:   <os>
Jul 31 12:15:42 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:15:42 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:15:42 user nova-compute[72447]:   </os>
Jul 31 12:15:42 user nova-compute[72447]:   <features>
Jul 31 12:15:42 user nova-compute[72447]:     <acpi/>
Jul 31 12:15:42 user nova-compute[72447]:     <apic/>
Jul 31 12:15:42 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:15:42 user nova-compute[72447]:   </features>
Jul 31 12:15:42 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:15:42 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:15:42 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:15:42 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:15:42 user nova-compute[72447]:   </clock>
Jul 31 12:15:42 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:15:42 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:15:42 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:15:42 user nova-compute[72447]:   </cpu>
Jul 31 12:15:42 user nova-compute[72447]:   <devices>
Jul 31 12:15:42 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:15:42 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:15:42 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.rescue"/>
Jul 31 12:15:42 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:15:42 user nova-compute[72447]:     </disk>
Jul 31 12:15:42 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:15:42 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:15:42 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk"/>
Jul 31 12:15:42 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:15:42 user nova-compute[72447]:     </disk>
Jul 31 12:15:42 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:15:42 user nova-compute[72447]:       <mac address="fa:16:3e:cf:66:ee"/>
Jul 31 12:15:42 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:15:42 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:15:42 user nova-compute[72447]:       <target dev="tap845d0677-fd"/>
Jul 31 12:15:42 user nova-compute[72447]:     </interface>
Jul 31 12:15:42 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:15:42 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/console.log" append="off"/>
Jul 31 12:15:42 user nova-compute[72447]:     </serial>
Jul 31 12:15:42 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:15:42 user nova-compute[72447]:     <video>
Jul 31 12:15:42 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:15:42 user nova-compute[72447]:     </video>
Jul 31 12:15:42 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:15:42 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:15:42 user nova-compute[72447]:     </rng>
Jul 31 12:15:42 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:15:42 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:15:42 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:15:42 user nova-compute[72447]:     </memballoon>
Jul 31 12:15:42 user nova-compute[72447]:   </devices>
Jul 31 12:15:42 user nova-compute[72447]: </domain>
Jul 31 12:15:42 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:15:42 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Instance destroyed successfully.
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:15:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No VIF found with MAC fa:16:3e:cf:66:ee, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:15:43 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:15:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-3f8061f2-a764-4534-a22a-465a1791f9cd req-5af6cc99-a260-49dd-911e-35c0a5e7c531 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3f8061f2-a764-4534-a22a-465a1791f9cd req-5af6cc99-a260-49dd-911e-35c0a5e7c531 service nova] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3f8061f2-a764-4534-a22a-465a1791f9cd req-5af6cc99-a260-49dd-911e-35c0a5e7c531 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3f8061f2-a764-4534-a22a-465a1791f9cd req-5af6cc99-a260-49dd-911e-35c0a5e7c531 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-3f8061f2-a764-4534-a22a-465a1791f9cd req-5af6cc99-a260-49dd-911e-35c0a5e7c531 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] No waiting events found dispatching network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:44 user nova-compute[72447]: WARNING nova.compute.manager [req-3f8061f2-a764-4534-a22a-465a1791f9cd req-5af6cc99-a260-49dd-911e-35c0a5e7c531 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received unexpected event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 for instance with vm_state active and task_state rescuing.
Jul 31 12:15:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:45 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:15:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-2ae1610f-24c2-4936-8024-e02105363d73 req-1032b81d-245d-4fcb-99a3-1fbdcb66f7d8 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2ae1610f-24c2-4936-8024-e02105363d73 req-1032b81d-245d-4fcb-99a3-1fbdcb66f7d8 service nova] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2ae1610f-24c2-4936-8024-e02105363d73 req-1032b81d-245d-4fcb-99a3-1fbdcb66f7d8 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2ae1610f-24c2-4936-8024-e02105363d73 req-1032b81d-245d-4fcb-99a3-1fbdcb66f7d8 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-2ae1610f-24c2-4936-8024-e02105363d73 req-1032b81d-245d-4fcb-99a3-1fbdcb66f7d8 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] No waiting events found dispatching network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:46 user nova-compute[72447]: WARNING nova.compute.manager [req-2ae1610f-24c2-4936-8024-e02105363d73 req-1032b81d-245d-4fcb-99a3-1fbdcb66f7d8 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received unexpected event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 for instance with vm_state active and task_state rescuing.
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-2ae1610f-24c2-4936-8024-e02105363d73 req-1032b81d-245d-4fcb-99a3-1fbdcb66f7d8 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2ae1610f-24c2-4936-8024-e02105363d73 req-1032b81d-245d-4fcb-99a3-1fbdcb66f7d8 service nova] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2ae1610f-24c2-4936-8024-e02105363d73 req-1032b81d-245d-4fcb-99a3-1fbdcb66f7d8 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2ae1610f-24c2-4936-8024-e02105363d73 req-1032b81d-245d-4fcb-99a3-1fbdcb66f7d8 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-2ae1610f-24c2-4936-8024-e02105363d73 req-1032b81d-245d-4fcb-99a3-1fbdcb66f7d8 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] No waiting events found dispatching network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:46 user nova-compute[72447]: WARNING nova.compute.manager [req-2ae1610f-24c2-4936-8024-e02105363d73 req-1032b81d-245d-4fcb-99a3-1fbdcb66f7d8 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received unexpected event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 for instance with vm_state active and task_state rescuing.
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 981b694a-bf63-4f4b-95c5-bc17aa72b87b due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805746.7399259, 981b694a-bf63-4f4b-95c5-bc17aa72b87b => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:15:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] VM Resumed (Lifecycle Event)
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6c678493-fb67-4fd7-8016-a6321cef7487 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:15:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805746.741024, 981b694a-bf63-4f4b-95c5-bc17aa72b87b => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:15:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] VM Started (Lifecycle Event)
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "51e36718-ed91-4dc5-82db-1f429df14d2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:15:47 user nova-compute[72447]: INFO nova.compute.claims [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Claim successful on node user
Jul 31 12:15:47 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:15:47 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:15:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:15:47 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Creating image(s)
Jul 31 12:15:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "/opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "/opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "/opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG nova.policy [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33268392189342ecbca53c9ad959245e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a055fae579aa4858867824625e8bd18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.167s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.182s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk 1073741824" returned: 0 in 0.067s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.168s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-700d80d6-9248-4d6f-9010-c3904d8fec2c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-700d80d6-9248-4d6f-9010-c3904d8fec2c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Cannot resize image /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'migration_context' on Instance uuid 51e36718-ed91-4dc5-82db-1f429df14d2f {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Ensure instance console log exists: /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:49 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Successfully created port: 3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Updating instance_info_cache with network_info: [{"id": "29928bd0-ae23-4a93-ba76-d4df44512908", "address": "fa:16:3e:35:f3:1f", "network": {"id": "9e4d5fcf-1179-404a-97a7-bf749934d047", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1726752963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639d35cc656e4dae8c062e531e6d2dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29928bd0-ae", "ovs_interfaceid": "29928bd0-ae23-4a93-ba76-d4df44512908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-700d80d6-9248-4d6f-9010-c3904d8fec2c" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Successfully updated port: 3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-22427a28-0328-4a8e-ac42-c195adfff578 req-76e6a1f2-f617-4987-ae85-251745251ac0 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Received event network-changed-3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-22427a28-0328-4a8e-ac42-c195adfff578 req-76e6a1f2-f617-4987-ae85-251745251ac0 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Refreshing instance network info cache due to event network-changed-3f2a18de-e66e-4924-9216-cbd14e4aa8de. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-22427a28-0328-4a8e-ac42-c195adfff578 req-76e6a1f2-f617-4987-ae85-251745251ac0 service nova] Acquiring lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-22427a28-0328-4a8e-ac42-c195adfff578 req-76e6a1f2-f617-4987-ae85-251745251ac0 service nova] Acquired lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG nova.network.neutron [req-22427a28-0328-4a8e-ac42-c195adfff578 req-76e6a1f2-f617-4987-ae85-251745251ac0 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Refreshing network info cache for port 3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG nova.network.neutron [req-22427a28-0328-4a8e-ac42-c195adfff578 req-76e6a1f2-f617-4987-ae85-251745251ac0 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.network.neutron [req-22427a28-0328-4a8e-ac42-c195adfff578 req-76e6a1f2-f617-4987-ae85-251745251ac0 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-22427a28-0328-4a8e-ac42-c195adfff578 req-76e6a1f2-f617-4987-ae85-251745251ac0 service nova] Releasing lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquired lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Updating instance_info_cache with network_info: [{"id": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "address": "fa:16:3e:4e:fc:4a", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a18de-e6", "ovs_interfaceid": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Releasing lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Instance network_info: |[{"id": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "address": "fa:16:3e:4e:fc:4a", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a18de-e6", "ovs_interfaceid": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Start _get_guest_xml network_info=[{"id": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "address": "fa:16:3e:4e:fc:4a", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a18de-e6", "ovs_interfaceid": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:15:52 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:15:52 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369190453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369190453',id=15,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-07tpwfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:15:48Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=51e36718-ed91-4dc5-82db-1f429df14d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "address": "fa:16:3e:4e:fc:4a", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a18de-e6", "ovs_interfaceid": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "address": "fa:16:3e:4e:fc:4a", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a18de-e6", "ovs_interfaceid": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fc:4a,bridge_name='br-int',has_traffic_filtering=True,id=3f2a18de-e66e-4924-9216-cbd14e4aa8de,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a18de-e6') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'pci_devices' on Instance uuid 51e36718-ed91-4dc5-82db-1f429df14d2f {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:15:53 user nova-compute[72447]:   <uuid>51e36718-ed91-4dc5-82db-1f429df14d2f</uuid>
Jul 31 12:15:53 user nova-compute[72447]:   <name>instance-0000000f</name>
Jul 31 12:15:53 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:15:53 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:15:53 user nova-compute[72447]:   <metadata>
Jul 31 12:15:53 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:15:53 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:15:53 user nova-compute[72447]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1369190453</nova:name>
Jul 31 12:15:53 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:15:52</nova:creationTime>
Jul 31 12:15:53 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:15:53 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:15:53 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:15:53 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:15:53 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:15:53 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:15:53 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:15:53 user nova-compute[72447]:       <nova:owner>
Jul 31 12:15:53 user nova-compute[72447]:         <nova:user uuid="33268392189342ecbca53c9ad959245e">tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member</nova:user>
Jul 31 12:15:53 user nova-compute[72447]:         <nova:project uuid="a055fae579aa4858867824625e8bd18d">tempest-ServerBootFromVolumeStableRescueTest-1637857313</nova:project>
Jul 31 12:15:53 user nova-compute[72447]:       </nova:owner>
Jul 31 12:15:53 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:15:53 user nova-compute[72447]:       <nova:ports>
Jul 31 12:15:53 user nova-compute[72447]:         <nova:port uuid="3f2a18de-e66e-4924-9216-cbd14e4aa8de">
Jul 31 12:15:53 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 12:15:53 user nova-compute[72447]:         </nova:port>
Jul 31 12:15:53 user nova-compute[72447]:       </nova:ports>
Jul 31 12:15:53 user nova-compute[72447]:     </nova:instance>
Jul 31 12:15:53 user nova-compute[72447]:   </metadata>
Jul 31 12:15:53 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:15:53 user nova-compute[72447]:     <system>
Jul 31 12:15:53 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:15:53 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:15:53 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:15:53 user nova-compute[72447]:       <entry name="serial">51e36718-ed91-4dc5-82db-1f429df14d2f</entry>
Jul 31 12:15:53 user nova-compute[72447]:       <entry name="uuid">51e36718-ed91-4dc5-82db-1f429df14d2f</entry>
Jul 31 12:15:53 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:15:53 user nova-compute[72447]:     </system>
Jul 31 12:15:53 user nova-compute[72447]:   </sysinfo>
Jul 31 12:15:53 user nova-compute[72447]:   <os>
Jul 31 12:15:53 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:15:53 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:15:53 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:15:53 user nova-compute[72447]:   </os>
Jul 31 12:15:53 user nova-compute[72447]:   <features>
Jul 31 12:15:53 user nova-compute[72447]:     <acpi/>
Jul 31 12:15:53 user nova-compute[72447]:     <apic/>
Jul 31 12:15:53 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:15:53 user nova-compute[72447]:   </features>
Jul 31 12:15:53 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:15:53 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:15:53 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:15:53 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:15:53 user nova-compute[72447]:   </clock>
Jul 31 12:15:53 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:15:53 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:15:53 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:15:53 user nova-compute[72447]:   </cpu>
Jul 31 12:15:53 user nova-compute[72447]:   <devices>
Jul 31 12:15:53 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:15:53 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:15:53 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk"/>
Jul 31 12:15:53 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:15:53 user nova-compute[72447]:     </disk>
Jul 31 12:15:53 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:15:53 user nova-compute[72447]:       <mac address="fa:16:3e:4e:fc:4a"/>
Jul 31 12:15:53 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:15:53 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:15:53 user nova-compute[72447]:       <target dev="tap3f2a18de-e6"/>
Jul 31 12:15:53 user nova-compute[72447]:     </interface>
Jul 31 12:15:53 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:15:53 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/console.log" append="off"/>
Jul 31 12:15:53 user nova-compute[72447]:     </serial>
Jul 31 12:15:53 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:15:53 user nova-compute[72447]:     <video>
Jul 31 12:15:53 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:15:53 user nova-compute[72447]:     </video>
Jul 31 12:15:53 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:15:53 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:15:53 user nova-compute[72447]:     </rng>
Jul 31 12:15:53 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:15:53 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:15:53 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:15:53 user nova-compute[72447]:     </memballoon>
Jul 31 12:15:53 user nova-compute[72447]:   </devices>
Jul 31 12:15:53 user nova-compute[72447]: </domain>
Jul 31 12:15:53 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369190453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369190453',id=15,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-07tpwfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:15:48Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=51e36718-ed91-4dc5-82db-1f429df14d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "address": "fa:16:3e:4e:fc:4a", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a18de-e6", "ovs_interfaceid": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "address": "fa:16:3e:4e:fc:4a", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a18de-e6", "ovs_interfaceid": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fc:4a,bridge_name='br-int',has_traffic_filtering=True,id=3f2a18de-e66e-4924-9216-cbd14e4aa8de,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a18de-e6') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG os_vif [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fc:4a,bridge_name='br-int',has_traffic_filtering=True,id=3f2a18de-e66e-4924-9216-cbd14e4aa8de,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a18de-e6') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f2a18de-e6, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f2a18de-e6, col_values=(('external_ids', {'iface-id': '3f2a18de-e66e-4924-9216-cbd14e4aa8de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:fc:4a', 'vm-uuid': '51e36718-ed91-4dc5-82db-1f429df14d2f'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:15:53 user nova-compute[72447]: INFO os_vif [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fc:4a,bridge_name='br-int',has_traffic_filtering=True,id=3f2a18de-e66e-4924-9216-cbd14e4aa8de,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a18de-e6')
Jul 31 12:15:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No VIF found with MAC fa:16:3e:4e:fc:4a, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:15:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805757.1151214, 51e36718-ed91-4dc5-82db-1f429df14d2f => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:15:57 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] VM Resumed (Lifecycle Event)
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-9e228621-74f0-4c7a-94ad-491c6ea140ce req-7a6ee13a-cf05-40f5-abd3-d6a3ff2c4779 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Received event network-vif-plugged-3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9e228621-74f0-4c7a-94ad-491c6ea140ce req-7a6ee13a-cf05-40f5-abd3-d6a3ff2c4779 service nova] Acquiring lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9e228621-74f0-4c7a-94ad-491c6ea140ce req-7a6ee13a-cf05-40f5-abd3-d6a3ff2c4779 service nova] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9e228621-74f0-4c7a-94ad-491c6ea140ce req-7a6ee13a-cf05-40f5-abd3-d6a3ff2c4779 service nova] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-9e228621-74f0-4c7a-94ad-491c6ea140ce req-7a6ee13a-cf05-40f5-abd3-d6a3ff2c4779 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] No waiting events found dispatching network-vif-plugged-3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:57 user nova-compute[72447]: WARNING nova.compute.manager [req-9e228621-74f0-4c7a-94ad-491c6ea140ce req-7a6ee13a-cf05-40f5-abd3-d6a3ff2c4779 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Received unexpected event network-vif-plugged-3f2a18de-e66e-4924-9216-cbd14e4aa8de for instance with vm_state building and task_state spawning.
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-3d0d6829-44d3-44c4-ba8c-0e16b018a7e9 req-e27004ba-1f21-4e09-83cb-4601f7fe4d37 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Received event network-vif-plugged-3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3d0d6829-44d3-44c4-ba8c-0e16b018a7e9 req-e27004ba-1f21-4e09-83cb-4601f7fe4d37 service nova] Acquiring lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3d0d6829-44d3-44c4-ba8c-0e16b018a7e9 req-e27004ba-1f21-4e09-83cb-4601f7fe4d37 service nova] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3d0d6829-44d3-44c4-ba8c-0e16b018a7e9 req-e27004ba-1f21-4e09-83cb-4601f7fe4d37 service nova] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-3d0d6829-44d3-44c4-ba8c-0e16b018a7e9 req-e27004ba-1f21-4e09-83cb-4601f7fe4d37 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] No waiting events found dispatching network-vif-plugged-3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:15:57 user nova-compute[72447]: WARNING nova.compute.manager [req-3d0d6829-44d3-44c4-ba8c-0e16b018a7e9 req-e27004ba-1f21-4e09-83cb-4601f7fe4d37 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Received unexpected event network-vif-plugged-3f2a18de-e66e-4924-9216-cbd14e4aa8de for instance with vm_state building and task_state spawning.
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:57 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Instance spawned successfully.
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:15:57 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:15:57 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7665MB free_disk=25.43056869506836GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:15:57 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805757.1188824, 51e36718-ed91-4dc5-82db-1f429df14d2f => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:15:57 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] VM Started (Lifecycle Event)
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:15:57 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:15:57 user nova-compute[72447]: INFO nova.compute.manager [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Took 10.15 seconds to spawn the instance on the hypervisor.
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance ba0c6dba-0035-4196-a05f-9335436fac86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 700d80d6-9248-4d6f-9010-c3904d8fec2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6c701045-e520-421f-94d2-b54edd0d5c54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2f98bc8b-537a-4b34-85ce-d7baac240046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:15:57 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:15:58 user nova-compute[72447]: INFO nova.compute.manager [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Took 10.99 seconds to build instance.
Jul 31 12:15:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3defc1e3-1d6e-4fe2-98d9-b6595fafc66b tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.120s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:58 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:15:58 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:15:58 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:15:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.702s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:15:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "ba0c6dba-0035-4196-a05f-9335436fac86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:15:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "ba0c6dba-0035-4196-a05f-9335436fac86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:15:59 user nova-compute[72447]: INFO nova.compute.manager [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Detaching volume 35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2
Jul 31 12:15:59 user nova-compute[72447]: INFO nova.virt.block_device [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Attempting to driver detach volume 35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 from mountpoint /dev/vdb
Jul 31 12:15:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Attempting to detach device vdb from instance ba0c6dba-0035-4196-a05f-9335436fac86 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:15:59 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:15:59 user nova-compute[72447]:   <source dev="/dev/sdh"/>
Jul 31 12:15:59 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:15:59 user nova-compute[72447]:   <serial>35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2</serial>
Jul 31 12:15:59 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:15:59 user nova-compute[72447]: </disk>
Jul 31 12:15:59 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:15:59 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully detached device vdb from instance ba0c6dba-0035-4196-a05f-9335436fac86 from the persistent domain config.
Jul 31 12:15:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba0c6dba-0035-4196-a05f-9335436fac86 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:15:59 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:15:59 user nova-compute[72447]:   <source dev="/dev/sdh"/>
Jul 31 12:15:59 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:15:59 user nova-compute[72447]:   <serial>35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2</serial>
Jul 31 12:15:59 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:15:59 user nova-compute[72447]: </disk>
Jul 31 12:15:59 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690805759.8401837, ba0c6dba-0035-4196-a05f-9335436fac86 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba0c6dba-0035-4196-a05f-9335436fac86 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:15:59 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully detached device vdb from instance ba0c6dba-0035-4196-a05f-9335436fac86 from the live domain config.
Jul 31 12:15:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBcJpXds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:15:59 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:15:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cc6be5-36bd-4d36-b3b2-a756d9fcdf92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[776de3a8-15c0-49e4-a7eb-8727b33a585b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:15:59 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:15:59 user nova-compute[72447]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f (non-flash)
Jul 31 12:15:59 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:15:59 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:15:59 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:15:59 user nova-compute[72447]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f (non-flash)
Jul 31 12:15:59 user nova-compute[72447]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 (non-flash)
Jul 31 12:15:59 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06683e3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2'): ({'sdh'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Removing single pathed devices sdh {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c1f24e-c4ce-45ad-94c7-5fce4b81d55e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaedc51-82ea-4b20-b3cf-eb2956c04fee]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Flushing IO for device /dev/sdh {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:15:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e768089-cba8-4000-ac07-cf10db299a7f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceef788-7822-43bb-97d0-be0be0e94d94]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] SCSI volumes sdh have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ff9ba8-e907-4e5a-90df-d578fd0f90a9]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82f9647-e4fa-472e-816b-005aa479850f]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2, portal: 172.16.0.220,3260]
Jul 31 12:16:00 user nova-compute[72447]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2, portal: 172.16.0.220,3260] successful.
Jul 31 12:16:00 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35bd2d2b-cc5c-43aa-bf31-a29a093f9ad2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7f29e9-663d-4c00-bb50-144a6051efef]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] <== disconnect_volume: return (334ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:16:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:01 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'flavor' on Instance uuid ba0c6dba-0035-4196-a05f-9335436fac86 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:16:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3531d30f-23ef-4919-9113-54f547513241 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "ba0c6dba-0035-4196-a05f-9335436fac86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.150s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:16:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:16:05 user nova-compute[72447]: INFO nova.compute.claims [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Claim successful on node user
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG nova.compute.manager [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.128s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:16:06 user nova-compute[72447]: INFO nova.compute.claims [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Claim successful on node user
Jul 31 12:16:06 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:16:06 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:16:06 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:16:06 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Creating image(s)
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "/opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "/opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "/opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.189s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.policy [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bfd7290fb1a45b7a27cfb5faa08cc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afa936e9674cce91443f7bef7409ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.165s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk 1073741824" returned: 0 in 0.060s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.network.neutron [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:16:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.186s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.policy [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '179d710ed6d3412bbfd665d30ccc6451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cdf6c9123e14bf7aa1dc369852d1f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:16:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Creating image(s)
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "/opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "/opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "/opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Cannot resize image /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.objects.instance [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'migration_context' on Instance uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Ensure instance console log exists: /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.159s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.150s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk 1073741824" returned: 0 in 0.064s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.166s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Cannot resize image /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG nova.objects.instance [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'migration_context' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Ensure instance console log exists: /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG nova.network.neutron [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Successfully created port: fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:16:08 user nova-compute[72447]: DEBUG nova.network.neutron [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Successfully created port: 8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:16:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG nova.network.neutron [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Successfully updated port: 8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquired lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG nova.network.neutron [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG nova.network.neutron [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Successfully updated port: fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquired lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG nova.network.neutron [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-2fa9acba-8e85-4e6c-b573-7f8b6f68bcee req-d96f0872-e427-4e4d-81c5-e4c519fd6e90 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-changed-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-2fa9acba-8e85-4e6c-b573-7f8b6f68bcee req-d96f0872-e427-4e4d-81c5-e4c519fd6e90 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Refreshing instance network info cache due to event network-changed-8bf862f6-240f-47c4-bf1a-3cf399024ae2. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2fa9acba-8e85-4e6c-b573-7f8b6f68bcee req-d96f0872-e427-4e4d-81c5-e4c519fd6e90 service nova] Acquiring lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG nova.network.neutron [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:16:10 user nova-compute[72447]: DEBUG nova.network.neutron [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:16:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:11 user nova-compute[72447]: DEBUG nova.network.neutron [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updating instance_info_cache with network_info: [{"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Releasing lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Instance network_info: |[{"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Start _get_guest_xml network_info=[{"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:16:12 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:16:12 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-615647500',display_name='tempest-ServerActionsTestOtherA-server-615647500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-615647500',id=16,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWDGihKbMeCNvBwsaW6V6P8R5lowbGENHMAc92pWv6O2vQFLobOnEOvb/OjxIDRXej4CqXst6J0oTtwIiGi8MF4pETlYJBg2aTwKoMBAuzDXV9HfutMu8dkCAol0vT0Q==',key_name='tempest-keypair-1212175094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25afa936e9674cce91443f7bef7409ab',ramdisk_id='',reservation_id='r-9wvn7yz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1904418117',owner_user_name='tempest-ServerActionsTestOtherA-1904418117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfd7290fb1a45b7a27cfb5faa08cc5d',uuid=51310b38-96e0-4d44-ab1e-8d2cc039617e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converting VIF {"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.objects.instance [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'pci_devices' on Instance uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:16:12 user nova-compute[72447]:   <uuid>51310b38-96e0-4d44-ab1e-8d2cc039617e</uuid>
Jul 31 12:16:12 user nova-compute[72447]:   <name>instance-00000010</name>
Jul 31 12:16:12 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:16:12 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:16:12 user nova-compute[72447]:   <metadata>
Jul 31 12:16:12 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:16:12 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:16:12 user nova-compute[72447]:       <nova:name>tempest-ServerActionsTestOtherA-server-615647500</nova:name>
Jul 31 12:16:12 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:16:12</nova:creationTime>
Jul 31 12:16:12 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:16:12 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:16:12 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:16:12 user nova-compute[72447]:       <nova:owner>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:user uuid="0bfd7290fb1a45b7a27cfb5faa08cc5d">tempest-ServerActionsTestOtherA-1904418117-project-member</nova:user>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:project uuid="25afa936e9674cce91443f7bef7409ab">tempest-ServerActionsTestOtherA-1904418117</nova:project>
Jul 31 12:16:12 user nova-compute[72447]:       </nova:owner>
Jul 31 12:16:12 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:16:12 user nova-compute[72447]:       <nova:ports>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:port uuid="fe243daf-4d07-48dd-84c9-1252c65085ed">
Jul 31 12:16:12 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 12:16:12 user nova-compute[72447]:         </nova:port>
Jul 31 12:16:12 user nova-compute[72447]:       </nova:ports>
Jul 31 12:16:12 user nova-compute[72447]:     </nova:instance>
Jul 31 12:16:12 user nova-compute[72447]:   </metadata>
Jul 31 12:16:12 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:16:12 user nova-compute[72447]:     <system>
Jul 31 12:16:12 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:16:12 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:16:12 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:16:12 user nova-compute[72447]:       <entry name="serial">51310b38-96e0-4d44-ab1e-8d2cc039617e</entry>
Jul 31 12:16:12 user nova-compute[72447]:       <entry name="uuid">51310b38-96e0-4d44-ab1e-8d2cc039617e</entry>
Jul 31 12:16:12 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:16:12 user nova-compute[72447]:     </system>
Jul 31 12:16:12 user nova-compute[72447]:   </sysinfo>
Jul 31 12:16:12 user nova-compute[72447]:   <os>
Jul 31 12:16:12 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:16:12 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:16:12 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:16:12 user nova-compute[72447]:   </os>
Jul 31 12:16:12 user nova-compute[72447]:   <features>
Jul 31 12:16:12 user nova-compute[72447]:     <acpi/>
Jul 31 12:16:12 user nova-compute[72447]:     <apic/>
Jul 31 12:16:12 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:16:12 user nova-compute[72447]:   </features>
Jul 31 12:16:12 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:16:12 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:16:12 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:16:12 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:16:12 user nova-compute[72447]:   </clock>
Jul 31 12:16:12 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:16:12 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:16:12 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:16:12 user nova-compute[72447]:   </cpu>
Jul 31 12:16:12 user nova-compute[72447]:   <devices>
Jul 31 12:16:12 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:16:12 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:16:12 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk"/>
Jul 31 12:16:12 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:16:12 user nova-compute[72447]:     </disk>
Jul 31 12:16:12 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:16:12 user nova-compute[72447]:       <mac address="fa:16:3e:8c:ca:e2"/>
Jul 31 12:16:12 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:16:12 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:16:12 user nova-compute[72447]:       <target dev="tapfe243daf-4d"/>
Jul 31 12:16:12 user nova-compute[72447]:     </interface>
Jul 31 12:16:12 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:16:12 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/console.log" append="off"/>
Jul 31 12:16:12 user nova-compute[72447]:     </serial>
Jul 31 12:16:12 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:16:12 user nova-compute[72447]:     <video>
Jul 31 12:16:12 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:16:12 user nova-compute[72447]:     </video>
Jul 31 12:16:12 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:16:12 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:16:12 user nova-compute[72447]:     </rng>
Jul 31 12:16:12 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:16:12 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:16:12 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:16:12 user nova-compute[72447]:     </memballoon>
Jul 31 12:16:12 user nova-compute[72447]:   </devices>
Jul 31 12:16:12 user nova-compute[72447]: </domain>
Jul 31 12:16:12 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-615647500',display_name='tempest-ServerActionsTestOtherA-server-615647500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-615647500',id=16,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWDGihKbMeCNvBwsaW6V6P8R5lowbGENHMAc92pWv6O2vQFLobOnEOvb/OjxIDRXej4CqXst6J0oTtwIiGi8MF4pETlYJBg2aTwKoMBAuzDXV9HfutMu8dkCAol0vT0Q==',key_name='tempest-keypair-1212175094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25afa936e9674cce91443f7bef7409ab',ramdisk_id='',reservation_id='r-9wvn7yz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1904418117',owner_user_name='tempest-ServerActionsTestOtherA-1904418117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfd7290fb1a45b7a27cfb5faa08cc5d',uuid=51310b38-96e0-4d44-ab1e-8d2cc039617e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converting VIF {"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG os_vif [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe243daf-4d, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe243daf-4d, col_values=(('external_ids', {'iface-id': 'fe243daf-4d07-48dd-84c9-1252c65085ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:ca:e2', 'vm-uuid': '51310b38-96e0-4d44-ab1e-8d2cc039617e'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:12 user nova-compute[72447]: INFO os_vif [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d')
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.network.neutron [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating instance_info_cache with network_info: [{"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Releasing lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Instance network_info: |[{"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2fa9acba-8e85-4e6c-b573-7f8b6f68bcee req-d96f0872-e427-4e4d-81c5-e4c519fd6e90 service nova] Acquired lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.network.neutron [req-2fa9acba-8e85-4e6c-b573-7f8b6f68bcee req-d96f0872-e427-4e4d-81c5-e4c519fd6e90 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Refreshing network info cache for port 8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Start _get_guest_xml network_info=[{"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] No VIF found with MAC fa:16:3e:8c:ca:e2, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:16:12 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:16:12 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-89958571',display_name='tempest-ServerActionsTestOtherB-server-89958571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-89958571',id=17,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+f+k0iUUuOhXlHDtikwFngFfrKZWO/pXd3lnR3i6FVV78yfGidAD1wnO5wJJhLxF9aq2IfkjSAFEQM+7NMJo1w081YcYQwauvTLFPqn5c5JoXRC/7+8j1JXyzJ3lUTfg==',key_name='tempest-keypair-1372814901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cdf6c9123e14bf7aa1dc369852d1f06',ramdisk_id='',reservation_id='r-6pk3jb2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1175098759',owner_user_name='tempest-ServerActionsTestOtherB-1175098759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='179d710ed6d3412bbfd665d30ccc6451',uuid=92ff498b-1337-47da-aaf1-b5fb9f19e98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converting VIF {"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.objects.instance [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'pci_devices' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:16:12 user nova-compute[72447]:   <uuid>92ff498b-1337-47da-aaf1-b5fb9f19e98d</uuid>
Jul 31 12:16:12 user nova-compute[72447]:   <name>instance-00000011</name>
Jul 31 12:16:12 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:16:12 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:16:12 user nova-compute[72447]:   <metadata>
Jul 31 12:16:12 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:16:12 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:16:12 user nova-compute[72447]:       <nova:name>tempest-ServerActionsTestOtherB-server-89958571</nova:name>
Jul 31 12:16:12 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:16:12</nova:creationTime>
Jul 31 12:16:12 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:16:12 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:16:12 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:16:12 user nova-compute[72447]:       <nova:owner>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:user uuid="179d710ed6d3412bbfd665d30ccc6451">tempest-ServerActionsTestOtherB-1175098759-project-member</nova:user>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:project uuid="2cdf6c9123e14bf7aa1dc369852d1f06">tempest-ServerActionsTestOtherB-1175098759</nova:project>
Jul 31 12:16:12 user nova-compute[72447]:       </nova:owner>
Jul 31 12:16:12 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:16:12 user nova-compute[72447]:       <nova:ports>
Jul 31 12:16:12 user nova-compute[72447]:         <nova:port uuid="8bf862f6-240f-47c4-bf1a-3cf399024ae2">
Jul 31 12:16:12 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 12:16:12 user nova-compute[72447]:         </nova:port>
Jul 31 12:16:12 user nova-compute[72447]:       </nova:ports>
Jul 31 12:16:12 user nova-compute[72447]:     </nova:instance>
Jul 31 12:16:12 user nova-compute[72447]:   </metadata>
Jul 31 12:16:12 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:16:12 user nova-compute[72447]:     <system>
Jul 31 12:16:12 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:16:12 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:16:12 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:16:12 user nova-compute[72447]:       <entry name="serial">92ff498b-1337-47da-aaf1-b5fb9f19e98d</entry>
Jul 31 12:16:12 user nova-compute[72447]:       <entry name="uuid">92ff498b-1337-47da-aaf1-b5fb9f19e98d</entry>
Jul 31 12:16:12 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:16:12 user nova-compute[72447]:     </system>
Jul 31 12:16:12 user nova-compute[72447]:   </sysinfo>
Jul 31 12:16:12 user nova-compute[72447]:   <os>
Jul 31 12:16:12 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:16:12 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:16:12 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:16:12 user nova-compute[72447]:   </os>
Jul 31 12:16:12 user nova-compute[72447]:   <features>
Jul 31 12:16:12 user nova-compute[72447]:     <acpi/>
Jul 31 12:16:12 user nova-compute[72447]:     <apic/>
Jul 31 12:16:12 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:16:12 user nova-compute[72447]:   </features>
Jul 31 12:16:12 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:16:12 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:16:12 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:16:12 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:16:12 user nova-compute[72447]:   </clock>
Jul 31 12:16:12 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:16:12 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:16:12 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:16:12 user nova-compute[72447]:   </cpu>
Jul 31 12:16:12 user nova-compute[72447]:   <devices>
Jul 31 12:16:12 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:16:12 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:16:12 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk"/>
Jul 31 12:16:12 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:16:12 user nova-compute[72447]:     </disk>
Jul 31 12:16:12 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:16:12 user nova-compute[72447]:       <mac address="fa:16:3e:f8:df:6b"/>
Jul 31 12:16:12 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:16:12 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:16:12 user nova-compute[72447]:       <target dev="tap8bf862f6-24"/>
Jul 31 12:16:12 user nova-compute[72447]:     </interface>
Jul 31 12:16:12 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:16:12 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/console.log" append="off"/>
Jul 31 12:16:12 user nova-compute[72447]:     </serial>
Jul 31 12:16:12 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:16:12 user nova-compute[72447]:     <video>
Jul 31 12:16:12 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:16:12 user nova-compute[72447]:     </video>
Jul 31 12:16:12 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:16:12 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:16:12 user nova-compute[72447]:     </rng>
Jul 31 12:16:12 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:16:12 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:16:12 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:16:12 user nova-compute[72447]:     </memballoon>
Jul 31 12:16:12 user nova-compute[72447]:   </devices>
Jul 31 12:16:12 user nova-compute[72447]: </domain>
Jul 31 12:16:12 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-89958571',display_name='tempest-ServerActionsTestOtherB-server-89958571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-89958571',id=17,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+f+k0iUUuOhXlHDtikwFngFfrKZWO/pXd3lnR3i6FVV78yfGidAD1wnO5wJJhLxF9aq2IfkjSAFEQM+7NMJo1w081YcYQwauvTLFPqn5c5JoXRC/7+8j1JXyzJ3lUTfg==',key_name='tempest-keypair-1372814901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cdf6c9123e14bf7aa1dc369852d1f06',ramdisk_id='',reservation_id='r-6pk3jb2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1175098759',owner_user_name='tempest-ServerActionsTestOtherB-1175098759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='179d710ed6d3412bbfd665d30ccc6451',uuid=92ff498b-1337-47da-aaf1-b5fb9f19e98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converting VIF {"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG os_vif [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bf862f6-24, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8bf862f6-24, col_values=(('external_ids', {'iface-id': '8bf862f6-240f-47c4-bf1a-3cf399024ae2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:df:6b', 'vm-uuid': '92ff498b-1337-47da-aaf1-b5fb9f19e98d'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:12 user nova-compute[72447]: INFO os_vif [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24')
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] No VIF found with MAC fa:16:3e:f8:df:6b, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-0ac6236a-0a26-4161-ab57-917532dcdbe5 req-5c8f0265-0bb3-4699-8bd9-96a59307f7d7 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-changed-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-0ac6236a-0a26-4161-ab57-917532dcdbe5 req-5c8f0265-0bb3-4699-8bd9-96a59307f7d7 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Refreshing instance network info cache due to event network-changed-fe243daf-4d07-48dd-84c9-1252c65085ed. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0ac6236a-0a26-4161-ab57-917532dcdbe5 req-5c8f0265-0bb3-4699-8bd9-96a59307f7d7 service nova] Acquiring lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0ac6236a-0a26-4161-ab57-917532dcdbe5 req-5c8f0265-0bb3-4699-8bd9-96a59307f7d7 service nova] Acquired lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:16:12 user nova-compute[72447]: DEBUG nova.network.neutron [req-0ac6236a-0a26-4161-ab57-917532dcdbe5 req-5c8f0265-0bb3-4699-8bd9-96a59307f7d7 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Refreshing network info cache for port fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:16:13 user nova-compute[72447]: DEBUG nova.network.neutron [req-2fa9acba-8e85-4e6c-b573-7f8b6f68bcee req-d96f0872-e427-4e4d-81c5-e4c519fd6e90 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updated VIF entry in instance network info cache for port 8bf862f6-240f-47c4-bf1a-3cf399024ae2. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:16:13 user nova-compute[72447]: DEBUG nova.network.neutron [req-2fa9acba-8e85-4e6c-b573-7f8b6f68bcee req-d96f0872-e427-4e4d-81c5-e4c519fd6e90 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating instance_info_cache with network_info: [{"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:16:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2fa9acba-8e85-4e6c-b573-7f8b6f68bcee req-d96f0872-e427-4e4d-81c5-e4c519fd6e90 service nova] Releasing lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:16:13 user nova-compute[72447]: DEBUG nova.network.neutron [req-0ac6236a-0a26-4161-ab57-917532dcdbe5 req-5c8f0265-0bb3-4699-8bd9-96a59307f7d7 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updated VIF entry in instance network info cache for port fe243daf-4d07-48dd-84c9-1252c65085ed. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:16:14 user nova-compute[72447]: DEBUG nova.network.neutron [req-0ac6236a-0a26-4161-ab57-917532dcdbe5 req-5c8f0265-0bb3-4699-8bd9-96a59307f7d7 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updating instance_info_cache with network_info: [{"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:16:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0ac6236a-0a26-4161-ab57-917532dcdbe5 req-5c8f0265-0bb3-4699-8bd9-96a59307f7d7 service nova] Releasing lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:16:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG nova.compute.manager [req-9bf987c8-b9e4-43ae-a7a6-337b88ab00c3 req-1275b49e-ed03-4306-b6c0-fcf01e5b6887 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9bf987c8-b9e4-43ae-a7a6-337b88ab00c3 req-1275b49e-ed03-4306-b6c0-fcf01e5b6887 service nova] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9bf987c8-b9e4-43ae-a7a6-337b88ab00c3 req-1275b49e-ed03-4306-b6c0-fcf01e5b6887 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9bf987c8-b9e4-43ae-a7a6-337b88ab00c3 req-1275b49e-ed03-4306-b6c0-fcf01e5b6887 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG nova.compute.manager [req-9bf987c8-b9e4-43ae-a7a6-337b88ab00c3 req-1275b49e-ed03-4306-b6c0-fcf01e5b6887 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] No waiting events found dispatching network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:16:15 user nova-compute[72447]: WARNING nova.compute.manager [req-9bf987c8-b9e4-43ae-a7a6-337b88ab00c3 req-1275b49e-ed03-4306-b6c0-fcf01e5b6887 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received unexpected event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 for instance with vm_state building and task_state spawning.
Jul 31 12:16:15 user nova-compute[72447]: DEBUG nova.compute.manager [req-dfe334ad-5cd6-49e1-9251-746efb4022c7 req-8875f6bb-158f-4c8c-97cf-3119f9dd8d0b service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-dfe334ad-5cd6-49e1-9251-746efb4022c7 req-8875f6bb-158f-4c8c-97cf-3119f9dd8d0b service nova] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-dfe334ad-5cd6-49e1-9251-746efb4022c7 req-8875f6bb-158f-4c8c-97cf-3119f9dd8d0b service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-dfe334ad-5cd6-49e1-9251-746efb4022c7 req-8875f6bb-158f-4c8c-97cf-3119f9dd8d0b service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:15 user nova-compute[72447]: DEBUG nova.compute.manager [req-dfe334ad-5cd6-49e1-9251-746efb4022c7 req-8875f6bb-158f-4c8c-97cf-3119f9dd8d0b service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] No waiting events found dispatching network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:16:15 user nova-compute[72447]: WARNING nova.compute.manager [req-dfe334ad-5cd6-49e1-9251-746efb4022c7 req-8875f6bb-158f-4c8c-97cf-3119f9dd8d0b service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received unexpected event network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed for instance with vm_state building and task_state spawning.
Jul 31 12:16:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-d092dd95-0645-4214-81fc-d885a106b8b8 req-f5f179ca-cca0-4093-ad0e-7b1ff9555a9d service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d092dd95-0645-4214-81fc-d885a106b8b8 req-f5f179ca-cca0-4093-ad0e-7b1ff9555a9d service nova] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d092dd95-0645-4214-81fc-d885a106b8b8 req-f5f179ca-cca0-4093-ad0e-7b1ff9555a9d service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d092dd95-0645-4214-81fc-d885a106b8b8 req-f5f179ca-cca0-4093-ad0e-7b1ff9555a9d service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-d092dd95-0645-4214-81fc-d885a106b8b8 req-f5f179ca-cca0-4093-ad0e-7b1ff9555a9d service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] No waiting events found dispatching network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:16:17 user nova-compute[72447]: WARNING nova.compute.manager [req-d092dd95-0645-4214-81fc-d885a106b8b8 req-f5f179ca-cca0-4093-ad0e-7b1ff9555a9d service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received unexpected event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 for instance with vm_state building and task_state spawning.
Jul 31 12:16:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-1977d582-e19c-4e9d-a404-5462e5680ec8 req-c453a9b0-3511-4ce4-a679-810f0cb8af78 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1977d582-e19c-4e9d-a404-5462e5680ec8 req-c453a9b0-3511-4ce4-a679-810f0cb8af78 service nova] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1977d582-e19c-4e9d-a404-5462e5680ec8 req-c453a9b0-3511-4ce4-a679-810f0cb8af78 service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1977d582-e19c-4e9d-a404-5462e5680ec8 req-c453a9b0-3511-4ce4-a679-810f0cb8af78 service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-1977d582-e19c-4e9d-a404-5462e5680ec8 req-c453a9b0-3511-4ce4-a679-810f0cb8af78 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] No waiting events found dispatching network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:16:17 user nova-compute[72447]: WARNING nova.compute.manager [req-1977d582-e19c-4e9d-a404-5462e5680ec8 req-c453a9b0-3511-4ce4-a679-810f0cb8af78 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received unexpected event network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed for instance with vm_state building and task_state spawning.
Jul 31 12:16:17 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805777.9452221, 51310b38-96e0-4d44-ab1e-8d2cc039617e => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:16:17 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] VM Resumed (Lifecycle Event)
Jul 31 12:16:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:16:17 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Instance spawned successfully.
Jul 31 12:16:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:16:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805777.9456549, 51310b38-96e0-4d44-ab1e-8d2cc039617e => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:16:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] VM Started (Lifecycle Event)
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:16:18 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Instance spawned successfully.
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:16:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805778.08172, 92ff498b-1337-47da-aaf1-b5fb9f19e98d => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:16:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] VM Resumed (Lifecycle Event)
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:16:18 user nova-compute[72447]: INFO nova.compute.manager [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Took 11.47 seconds to spawn the instance on the hypervisor.
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:16:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805778.0896375, 92ff498b-1337-47da-aaf1-b5fb9f19e98d => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:16:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] VM Started (Lifecycle Event)
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:16:18 user nova-compute[72447]: INFO nova.compute.manager [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Took 10.81 seconds to spawn the instance on the hypervisor.
Jul 31 12:16:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:16:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:16:18 user nova-compute[72447]: INFO nova.compute.manager [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Took 12.42 seconds to build instance.
Jul 31 12:16:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16c4359c-36d4-433a-ba47-64b466556006 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.691s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:18 user nova-compute[72447]: INFO nova.compute.manager [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Took 12.25 seconds to build instance.
Jul 31 12:16:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-eb12c88c-e08f-489c-ad71-7cb28eee51be tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.371s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:16:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:16:25 user nova-compute[72447]: INFO nova.compute.claims [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Claim successful on node user
Jul 31 12:16:26 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:16:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:16:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.840s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:16:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:16:26 user nova-compute[72447]: DEBUG nova.network.neutron [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:16:26 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:16:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:16:26 user nova-compute[72447]: DEBUG nova.policy [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a40e5176e01443a085c01fc677cc8ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c212a5254bcc4de290ec4bfbf8fbbd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:16:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:16:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:16:26 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Creating image(s)
Jul 31 12:16:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "/opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "/opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "/opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "ae7d4d240f015e711a223edff06f40af9833e632" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "ae7d4d240f015e711a223edff06f40af9833e632" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632.part --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632.part --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:27 user nova-compute[72447]: DEBUG nova.virt.images [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] c50de5cc-8b81-4552-a892-a8a60da6e3ac was qcow2, converting to raw {{(pid=72447) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 12:16:27 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:16:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632.part /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632.converted {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:27 user nova-compute[72447]: DEBUG nova.network.neutron [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Successfully created port: c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:16:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632.part /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632.converted" returned: 0 in 0.487s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632.converted --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "ae7d4d240f015e711a223edff06f40af9833e632" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.322s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632 --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632 --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "ae7d4d240f015e711a223edff06f40af9833e632" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "ae7d4d240f015e711a223edff06f40af9833e632" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632 --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632 --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632,backing_fmt=raw /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632,backing_fmt=raw /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk 1073741824" returned: 0 in 0.063s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "ae7d4d240f015e711a223edff06f40af9833e632" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632 --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632 --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG nova.network.neutron [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Successfully updated port: c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquired lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG nova.network.neutron [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-c4700767-d221-4dce-b436-e9a3b3e7b90e req-fbb9dd60-dbeb-481d-a1d2-44db887d0c94 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-changed-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-c4700767-d221-4dce-b436-e9a3b3e7b90e req-fbb9dd60-dbeb-481d-a1d2-44db887d0c94 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Refreshing instance network info cache due to event network-changed-c491e329-e20e-47e6-893a-7643968aba7e. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c4700767-d221-4dce-b436-e9a3b3e7b90e req-fbb9dd60-dbeb-481d-a1d2-44db887d0c94 service nova] Acquiring lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Cannot resize image /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG nova.objects.instance [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'migration_context' on Instance uuid e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Ensure instance console log exists: /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:28 user nova-compute[72447]: DEBUG nova.network.neutron [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.network.neutron [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updating instance_info_cache with network_info: [{"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Releasing lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Instance network_info: |[{"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c4700767-d221-4dce-b436-e9a3b3e7b90e req-fbb9dd60-dbeb-481d-a1d2-44db887d0c94 service nova] Acquired lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.network.neutron [req-c4700767-d221-4dce-b436-e9a3b3e7b90e req-fbb9dd60-dbeb-481d-a1d2-44db887d0c94 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Refreshing network info cache for port c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Start _get_guest_xml network_info=[{"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:16:22Z,direct_url=<?>,disk_format='qcow2',id=c50de5cc-8b81-4552-a892-a8a60da6e3ac,min_disk=0,min_ram=0,name='tempest-scenario-img--1965012094',owner='c212a5254bcc4de290ec4bfbf8fbbd4b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:16:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'c50de5cc-8b81-4552-a892-a8a60da6e3ac'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:16:29 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:16:29 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:16:22Z,direct_url=<?>,disk_format='qcow2',id=c50de5cc-8b81-4552-a892-a8a60da6e3ac,min_disk=0,min_ram=0,name='tempest-scenario-img--1965012094',owner='c212a5254bcc4de290ec4bfbf8fbbd4b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:16:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1639847318',display_name='tempest-TestMinimumBasicScenario-server-1639847318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1639847318',id=18,image_ref='c50de5cc-8b81-4552-a892-a8a60da6e3ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByc5+TYn0U9H18DTmmjCJIFBIkeEbJS4pya3RhJF5gO675iLeoBkMf6n1Bo415YPpSYsW3OKsfLEylBcx7ws9w5x+4Xov1Sp4zSG+cejgKWA/ew9wHMEi+FSgcvY5Lggg==',key_name='tempest-TestMinimumBasicScenario-182857311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c212a5254bcc4de290ec4bfbf8fbbd4b',ramdisk_id='',reservation_id='r-p5cjl6yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c50de5cc-8b81-4552-a892-a8a60da6e3ac',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1422809681',owner_user_name='tempest-TestMinimumBasicScenario-1422809681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:16:27Z,user_data=None,user_id='a40e5176e01443a085c01fc677cc8ca9',uuid=e75d2046-19d7-46b8-9c63-5af205c87c08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converting VIF {"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.objects.instance [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'pci_devices' on Instance uuid e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:16:29 user nova-compute[72447]:   <uuid>e75d2046-19d7-46b8-9c63-5af205c87c08</uuid>
Jul 31 12:16:29 user nova-compute[72447]:   <name>instance-00000012</name>
Jul 31 12:16:29 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:16:29 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:16:29 user nova-compute[72447]:   <metadata>
Jul 31 12:16:29 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:16:29 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:16:29 user nova-compute[72447]:       <nova:name>tempest-TestMinimumBasicScenario-server-1639847318</nova:name>
Jul 31 12:16:29 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:16:29</nova:creationTime>
Jul 31 12:16:29 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:16:29 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:16:29 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:16:29 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:16:29 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:16:29 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:16:29 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:16:29 user nova-compute[72447]:       <nova:owner>
Jul 31 12:16:29 user nova-compute[72447]:         <nova:user uuid="a40e5176e01443a085c01fc677cc8ca9">tempest-TestMinimumBasicScenario-1422809681-project-member</nova:user>
Jul 31 12:16:29 user nova-compute[72447]:         <nova:project uuid="c212a5254bcc4de290ec4bfbf8fbbd4b">tempest-TestMinimumBasicScenario-1422809681</nova:project>
Jul 31 12:16:29 user nova-compute[72447]:       </nova:owner>
Jul 31 12:16:29 user nova-compute[72447]:       <nova:root type="image" uuid="c50de5cc-8b81-4552-a892-a8a60da6e3ac"/>
Jul 31 12:16:29 user nova-compute[72447]:       <nova:ports>
Jul 31 12:16:29 user nova-compute[72447]:         <nova:port uuid="c491e329-e20e-47e6-893a-7643968aba7e">
Jul 31 12:16:29 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 12:16:29 user nova-compute[72447]:         </nova:port>
Jul 31 12:16:29 user nova-compute[72447]:       </nova:ports>
Jul 31 12:16:29 user nova-compute[72447]:     </nova:instance>
Jul 31 12:16:29 user nova-compute[72447]:   </metadata>
Jul 31 12:16:29 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:16:29 user nova-compute[72447]:     <system>
Jul 31 12:16:29 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:16:29 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:16:29 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:16:29 user nova-compute[72447]:       <entry name="serial">e75d2046-19d7-46b8-9c63-5af205c87c08</entry>
Jul 31 12:16:29 user nova-compute[72447]:       <entry name="uuid">e75d2046-19d7-46b8-9c63-5af205c87c08</entry>
Jul 31 12:16:29 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:16:29 user nova-compute[72447]:     </system>
Jul 31 12:16:29 user nova-compute[72447]:   </sysinfo>
Jul 31 12:16:29 user nova-compute[72447]:   <os>
Jul 31 12:16:29 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:16:29 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:16:29 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:16:29 user nova-compute[72447]:   </os>
Jul 31 12:16:29 user nova-compute[72447]:   <features>
Jul 31 12:16:29 user nova-compute[72447]:     <acpi/>
Jul 31 12:16:29 user nova-compute[72447]:     <apic/>
Jul 31 12:16:29 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:16:29 user nova-compute[72447]:   </features>
Jul 31 12:16:29 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:16:29 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:16:29 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:16:29 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:16:29 user nova-compute[72447]:   </clock>
Jul 31 12:16:29 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:16:29 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:16:29 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:16:29 user nova-compute[72447]:   </cpu>
Jul 31 12:16:29 user nova-compute[72447]:   <devices>
Jul 31 12:16:29 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:16:29 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:16:29 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk"/>
Jul 31 12:16:29 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:16:29 user nova-compute[72447]:     </disk>
Jul 31 12:16:29 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:16:29 user nova-compute[72447]:       <mac address="fa:16:3e:9a:97:2f"/>
Jul 31 12:16:29 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:16:29 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:16:29 user nova-compute[72447]:       <target dev="tapc491e329-e2"/>
Jul 31 12:16:29 user nova-compute[72447]:     </interface>
Jul 31 12:16:29 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:16:29 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/console.log" append="off"/>
Jul 31 12:16:29 user nova-compute[72447]:     </serial>
Jul 31 12:16:29 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:16:29 user nova-compute[72447]:     <video>
Jul 31 12:16:29 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:16:29 user nova-compute[72447]:     </video>
Jul 31 12:16:29 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:16:29 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:16:29 user nova-compute[72447]:     </rng>
Jul 31 12:16:29 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:16:29 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:16:29 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:16:29 user nova-compute[72447]:     </memballoon>
Jul 31 12:16:29 user nova-compute[72447]:   </devices>
Jul 31 12:16:29 user nova-compute[72447]: </domain>
Jul 31 12:16:29 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1639847318',display_name='tempest-TestMinimumBasicScenario-server-1639847318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1639847318',id=18,image_ref='c50de5cc-8b81-4552-a892-a8a60da6e3ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByc5+TYn0U9H18DTmmjCJIFBIkeEbJS4pya3RhJF5gO675iLeoBkMf6n1Bo415YPpSYsW3OKsfLEylBcx7ws9w5x+4Xov1Sp4zSG+cejgKWA/ew9wHMEi+FSgcvY5Lggg==',key_name='tempest-TestMinimumBasicScenario-182857311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c212a5254bcc4de290ec4bfbf8fbbd4b',ramdisk_id='',reservation_id='r-p5cjl6yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c50de5cc-8b81-4552-a892-a8a60da6e3ac',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1422809681',owner_user_name='tempest-TestMinimumBasicScenario-1422809681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:16:27Z,user_data=None,user_id='a40e5176e01443a085c01fc677cc8ca9',uuid=e75d2046-19d7-46b8-9c63-5af205c87c08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converting VIF {"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG os_vif [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc491e329-e2, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc491e329-e2, col_values=(('external_ids', {'iface-id': 'c491e329-e20e-47e6-893a-7643968aba7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:97:2f', 'vm-uuid': 'e75d2046-19d7-46b8-9c63-5af205c87c08'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:29 user nova-compute[72447]: INFO os_vif [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2')
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] No VIF found with MAC fa:16:3e:9a:97:2f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.network.neutron [req-c4700767-d221-4dce-b436-e9a3b3e7b90e req-fbb9dd60-dbeb-481d-a1d2-44db887d0c94 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updated VIF entry in instance network info cache for port c491e329-e20e-47e6-893a-7643968aba7e. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG nova.network.neutron [req-c4700767-d221-4dce-b436-e9a3b3e7b90e req-fbb9dd60-dbeb-481d-a1d2-44db887d0c94 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updating instance_info_cache with network_info: [{"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:16:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c4700767-d221-4dce-b436-e9a3b3e7b90e req-fbb9dd60-dbeb-481d-a1d2-44db887d0c94 service nova] Releasing lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:16:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-d831cb76-a4d5-4ac3-b8b0-0ff5d539d3a8 req-78af3d0d-f87e-4843-b3d6-cf62d721641a service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d831cb76-a4d5-4ac3-b8b0-0ff5d539d3a8 req-78af3d0d-f87e-4843-b3d6-cf62d721641a service nova] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d831cb76-a4d5-4ac3-b8b0-0ff5d539d3a8 req-78af3d0d-f87e-4843-b3d6-cf62d721641a service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d831cb76-a4d5-4ac3-b8b0-0ff5d539d3a8 req-78af3d0d-f87e-4843-b3d6-cf62d721641a service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-d831cb76-a4d5-4ac3-b8b0-0ff5d539d3a8 req-78af3d0d-f87e-4843-b3d6-cf62d721641a service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] No waiting events found dispatching network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:16:31 user nova-compute[72447]: WARNING nova.compute.manager [req-d831cb76-a4d5-4ac3-b8b0-0ff5d539d3a8 req-78af3d0d-f87e-4843-b3d6-cf62d721641a service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received unexpected event network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e for instance with vm_state building and task_state spawning.
Jul 31 12:16:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805793.0876918, e75d2046-19d7-46b8-9c63-5af205c87c08 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:16:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] VM Resumed (Lifecycle Event)
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:16:33 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Instance spawned successfully.
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-95ab6e0f-0699-4fb8-afcc-53b7bab57aed req-05ea371e-b6ed-4ec3-9b15-d32bff2aa4c9 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-95ab6e0f-0699-4fb8-afcc-53b7bab57aed req-05ea371e-b6ed-4ec3-9b15-d32bff2aa4c9 service nova] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-95ab6e0f-0699-4fb8-afcc-53b7bab57aed req-05ea371e-b6ed-4ec3-9b15-d32bff2aa4c9 service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-95ab6e0f-0699-4fb8-afcc-53b7bab57aed req-05ea371e-b6ed-4ec3-9b15-d32bff2aa4c9 service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-95ab6e0f-0699-4fb8-afcc-53b7bab57aed req-05ea371e-b6ed-4ec3-9b15-d32bff2aa4c9 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] No waiting events found dispatching network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:16:33 user nova-compute[72447]: WARNING nova.compute.manager [req-95ab6e0f-0699-4fb8-afcc-53b7bab57aed req-05ea371e-b6ed-4ec3-9b15-d32bff2aa4c9 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received unexpected event network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e for instance with vm_state building and task_state spawning.
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:16:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805793.0893707, e75d2046-19d7-46b8-9c63-5af205c87c08 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:16:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] VM Started (Lifecycle Event)
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:16:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:16:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Took 6.49 seconds to spawn the instance on the hypervisor.
Jul 31 12:16:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:16:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Took 7.72 seconds to build instance.
Jul 31 12:16:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b2cbfa2d-9bff-4115-9cc5-8d4b1595136c tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.812s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:40 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "6c701045-e520-421f-94d2-b54edd0d5c54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:42 user nova-compute[72447]: INFO nova.compute.manager [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Detaching volume 05147714-4486-4123-b02d-acff59beea1f
Jul 31 12:16:42 user nova-compute[72447]: INFO nova.virt.block_device [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Attempting to driver detach volume 05147714-4486-4123-b02d-acff59beea1f from mountpoint /dev/vdc
Jul 31 12:16:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Attempting to detach device vdc from instance 6c701045-e520-421f-94d2-b54edd0d5c54 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:16:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:16:42 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:16:42 user nova-compute[72447]:   <source dev="/dev/sdc"/>
Jul 31 12:16:42 user nova-compute[72447]:   <target dev="vdc" bus="virtio"/>
Jul 31 12:16:42 user nova-compute[72447]:   <serial>05147714-4486-4123-b02d-acff59beea1f</serial>
Jul 31 12:16:42 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 12:16:42 user nova-compute[72447]: </disk>
Jul 31 12:16:42 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:16:42 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Successfully detached device vdc from instance 6c701045-e520-421f-94d2-b54edd0d5c54 from the persistent domain config.
Jul 31 12:16:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6c701045-e520-421f-94d2-b54edd0d5c54 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:16:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:16:42 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:16:42 user nova-compute[72447]:   <source dev="/dev/sdc"/>
Jul 31 12:16:42 user nova-compute[72447]:   <target dev="vdc" bus="virtio"/>
Jul 31 12:16:42 user nova-compute[72447]:   <serial>05147714-4486-4123-b02d-acff59beea1f</serial>
Jul 31 12:16:42 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 12:16:42 user nova-compute[72447]: </disk>
Jul 31 12:16:42 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690805803.1702974, 6c701045-e520-421f-94d2-b54edd0d5c54 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:16:43 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Successfully detached device vdc from instance 6c701045-e520-421f-94d2-b54edd0d5c54 from the live domain config.
Jul 31 12:16:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxHFNDwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:16:43 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedddbcd-6fad-406e-b84e-8c56ab120bb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0881cc8-352f-4a5e-b3fb-4a6c400ddee0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:16:43 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:16:43 user nova-compute[72447]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f (non-flash)
Jul 31 12:16:43 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:16:43 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:16:43 user nova-compute[72447]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f (non-flash)
Jul 31 12:16:43 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06683f1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f'): ({'sdc'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Removing single pathed devices sdc {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3306d612-08e8-4faa-9ebf-69a13812b3c7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c161be81-efa6-4618-83d4-9a407af692bc]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Flushing IO for device /dev/sdc {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52bf984-ea42-4c1d-b067-83f41297ca26]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab5f2be-8444-41aa-8def-35a8d03f6c0e]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abf8c4f-78a2-4cb8-b1b9-2171f1d96473]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c41346f-a74e-438b-9b61-eb1f95ba7156]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f, portal: 172.16.0.220,3260]
Jul 31 12:16:43 user nova-compute[72447]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f, portal: 172.16.0.220,3260] successful.
Jul 31 12:16:43 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05147714-4486-4123-b02d-acff59beea1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[25942711-07b1-4d66-a95f-1bb1043ca09d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] <== disconnect_volume: return (354ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:16:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:16:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:44 user nova-compute[72447]: DEBUG nova.objects.instance [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'flavor' on Instance uuid 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:16:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-467a7497-03c2-4875-9db8-dcea529d6a06 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "6c701045-e520-421f-94d2-b54edd0d5c54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.832s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:45 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:48 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:16:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:16:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:16:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:16:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:16:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:16:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updating instance_info_cache with network_info: [{"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:16:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:16:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "ba0c6dba-0035-4196-a05f-9335436fac86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "ba0c6dba-0035-4196-a05f-9335436fac86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:49 user nova-compute[72447]: INFO nova.compute.manager [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Terminating instance
Jul 31 12:16:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-68957171-7b27-42da-a731-0a18aad72359 req-b99fdcde-38d3-4ece-8edf-3c0be06487bc service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Received event network-vif-unplugged-9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-68957171-7b27-42da-a731-0a18aad72359 req-b99fdcde-38d3-4ece-8edf-3c0be06487bc service nova] Acquiring lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-68957171-7b27-42da-a731-0a18aad72359 req-b99fdcde-38d3-4ece-8edf-3c0be06487bc service nova] Lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-68957171-7b27-42da-a731-0a18aad72359 req-b99fdcde-38d3-4ece-8edf-3c0be06487bc service nova] Lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-68957171-7b27-42da-a731-0a18aad72359 req-b99fdcde-38d3-4ece-8edf-3c0be06487bc service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] No waiting events found dispatching network-vif-unplugged-9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-68957171-7b27-42da-a731-0a18aad72359 req-b99fdcde-38d3-4ece-8edf-3c0be06487bc service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Received event network-vif-unplugged-9bc7922e-33db-4822-a9b9-497abe3fb078 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:16:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:50 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Instance destroyed successfully.
Jul 31 12:16:50 user nova-compute[72447]: DEBUG nova.objects.instance [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'resources' on Instance uuid ba0c6dba-0035-4196-a05f-9335436fac86 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-481837700',display_name='tempest-AttachVolumeNegativeTest-server-481837700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-481837700',id=5,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCRt23HQ6Lk87P8JMHTotxGoAotUIlM4JOz08FfG/cbe2eknZafwEtDDbG2dcLUw5pHA5nuMO3T0cIx4i2r2H4AHOXbrOZp2o6rHdjN4KUR6ynUZ6xh8kCnDPms+xXmGQ==',key_name='tempest-keypair-1748336898',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fad40b5f5e54e7ab9c6f8e78ceb3947',ramdisk_id='',reservation_id='r-j2bd0bsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-323727931',owner_user_name='tempest-AttachVolumeNegativeTest-323727931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a7feffde0f74f63a6bd027c1958aacb',uuid=ba0c6dba-0035-4196-a05f-9335436fac86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bc7922e-33db-4822-a9b9-497abe3fb078", "address": "fa:16:3e:62:fc:84", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc7922e-33", "ovs_interfaceid": "9bc7922e-33db-4822-a9b9-497abe3fb078", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converting VIF {"id": "9bc7922e-33db-4822-a9b9-497abe3fb078", "address": "fa:16:3e:62:fc:84", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc7922e-33", "ovs_interfaceid": "9bc7922e-33db-4822-a9b9-497abe3fb078", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=9bc7922e-33db-4822-a9b9-497abe3fb078,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc7922e-33') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG os_vif [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=9bc7922e-33db-4822-a9b9-497abe3fb078,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc7922e-33') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bc7922e-33, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:16:50 user nova-compute[72447]: INFO os_vif [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=9bc7922e-33db-4822-a9b9-497abe3fb078,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc7922e-33')
Jul 31 12:16:50 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Deleting instance files /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86_del
Jul 31 12:16:50 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Deletion of /opt/stack/data/nova/instances/ba0c6dba-0035-4196-a05f-9335436fac86_del complete
Jul 31 12:16:50 user nova-compute[72447]: INFO nova.compute.manager [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Took 0.83 seconds to destroy the instance on the hypervisor.
Jul 31 12:16:50 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 12:16:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] There are 0 instances to clean {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:16:51 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Took 1.05 seconds to deallocate network for instance.
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:51 user nova-compute[72447]: INFO nova.compute.manager [None req-da3af08f-95ef-4547-8e83-7099d6cdc754 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Unrescuing
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-da3af08f-95ef-4547-8e83-7099d6cdc754 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-da3af08f-95ef-4547-8e83-7099d6cdc754 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquired lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG nova.network.neutron [None req-da3af08f-95ef-4547-8e83-7099d6cdc754 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-260e3336-dab6-4df3-8735-f301375e25dc req-5de495c4-c802-4fe4-a6e8-cbb19836901b service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Received event network-vif-plugged-9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-260e3336-dab6-4df3-8735-f301375e25dc req-5de495c4-c802-4fe4-a6e8-cbb19836901b service nova] Acquiring lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-260e3336-dab6-4df3-8735-f301375e25dc req-5de495c4-c802-4fe4-a6e8-cbb19836901b service nova] Lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-260e3336-dab6-4df3-8735-f301375e25dc req-5de495c4-c802-4fe4-a6e8-cbb19836901b service nova] Lock "ba0c6dba-0035-4196-a05f-9335436fac86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-260e3336-dab6-4df3-8735-f301375e25dc req-5de495c4-c802-4fe4-a6e8-cbb19836901b service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] No waiting events found dispatching network-vif-plugged-9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:16:51 user nova-compute[72447]: WARNING nova.compute.manager [req-260e3336-dab6-4df3-8735-f301375e25dc req-5de495c4-c802-4fe4-a6e8-cbb19836901b service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Received unexpected event network-vif-plugged-9bc7922e-33db-4822-a9b9-497abe3fb078 for instance with vm_state deleted and task_state None.
Jul 31 12:16:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-260e3336-dab6-4df3-8735-f301375e25dc req-5de495c4-c802-4fe4-a6e8-cbb19836901b service nova] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Received event network-vif-deleted-9bc7922e-33db-4822-a9b9-497abe3fb078 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.664s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:52 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Deleted allocations for instance ba0c6dba-0035-4196-a05f-9335436fac86
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8e75a63c-aa6e-40aa-aff5-9b7158716016 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "ba0c6dba-0035-4196-a05f-9335436fac86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.770s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG nova.network.neutron [None req-da3af08f-95ef-4547-8e83-7099d6cdc754 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updating instance_info_cache with network_info: [{"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-da3af08f-95ef-4547-8e83-7099d6cdc754 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Releasing lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG nova.objects.instance [None req-da3af08f-95ef-4547-8e83-7099d6cdc754 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'flavor' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-124a8f3a-5b1c-4c6c-96ed-d2ebc6cbcd01 req-af97f476-705f-42ea-b6e5-2043c424ee84 service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Received event network-changed-ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-124a8f3a-5b1c-4c6c-96ed-d2ebc6cbcd01 req-af97f476-705f-42ea-b6e5-2043c424ee84 service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Refreshing instance network info cache due to event network-changed-ba08be19-41fe-4c05-8b70-b0b7a72760d2. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-124a8f3a-5b1c-4c6c-96ed-d2ebc6cbcd01 req-af97f476-705f-42ea-b6e5-2043c424ee84 service nova] Acquiring lock "refresh_cache-2f98bc8b-537a-4b34-85ce-d7baac240046" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-124a8f3a-5b1c-4c6c-96ed-d2ebc6cbcd01 req-af97f476-705f-42ea-b6e5-2043c424ee84 service nova] Acquired lock "refresh_cache-2f98bc8b-537a-4b34-85ce-d7baac240046" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG nova.network.neutron [req-124a8f3a-5b1c-4c6c-96ed-d2ebc6cbcd01 req-af97f476-705f-42ea-b6e5-2043c424ee84 service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Refreshing network info cache for port ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-2f995060-12b1-4a36-9518-a543379a49fb req-e5bf21d7-68d3-4ef9-8fe5-5dcb86d0e08d service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-unplugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2f995060-12b1-4a36-9518-a543379a49fb req-e5bf21d7-68d3-4ef9-8fe5-5dcb86d0e08d service nova] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2f995060-12b1-4a36-9518-a543379a49fb req-e5bf21d7-68d3-4ef9-8fe5-5dcb86d0e08d service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2f995060-12b1-4a36-9518-a543379a49fb req-e5bf21d7-68d3-4ef9-8fe5-5dcb86d0e08d service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-2f995060-12b1-4a36-9518-a543379a49fb req-e5bf21d7-68d3-4ef9-8fe5-5dcb86d0e08d service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] No waiting events found dispatching network-vif-unplugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:16:52 user nova-compute[72447]: WARNING nova.compute.manager [req-2f995060-12b1-4a36-9518-a543379a49fb req-e5bf21d7-68d3-4ef9-8fe5-5dcb86d0e08d service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received unexpected event network-vif-unplugged-f276935a-5cfd-4a23-a87e-cbab33adf21e for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:53 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Instance destroyed successfully.
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG nova.network.neutron [req-124a8f3a-5b1c-4c6c-96ed-d2ebc6cbcd01 req-af97f476-705f-42ea-b6e5-2043c424ee84 service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Updated VIF entry in instance network info cache for port ba08be19-41fe-4c05-8b70-b0b7a72760d2. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG nova.network.neutron [req-124a8f3a-5b1c-4c6c-96ed-d2ebc6cbcd01 req-af97f476-705f-42ea-b6e5-2043c424ee84 service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Updating instance_info_cache with network_info: [{"id": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "address": "fa:16:3e:41:f6:dd", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba08be19-41", "ovs_interfaceid": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-124a8f3a-5b1c-4c6c-96ed-d2ebc6cbcd01 req-af97f476-705f-42ea-b6e5-2043c424ee84 service nova] Releasing lock "refresh_cache-2f98bc8b-537a-4b34-85ce-d7baac240046" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG nova.compute.manager [req-728743f2-fa8e-44e0-bb80-e5339f3ade5e req-3b79b028-ab4c-446f-a43f-e870e9e37db9 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-changed-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG nova.compute.manager [req-728743f2-fa8e-44e0-bb80-e5339f3ade5e req-3b79b028-ab4c-446f-a43f-e870e9e37db9 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Refreshing instance network info cache due to event network-changed-f276935a-5cfd-4a23-a87e-cbab33adf21e. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-728743f2-fa8e-44e0-bb80-e5339f3ade5e req-3b79b028-ab4c-446f-a43f-e870e9e37db9 service nova] Acquiring lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-728743f2-fa8e-44e0-bb80-e5339f3ade5e req-3b79b028-ab4c-446f-a43f-e870e9e37db9 service nova] Acquired lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:16:53 user nova-compute[72447]: DEBUG nova.network.neutron [req-728743f2-fa8e-44e0-bb80-e5339f3ade5e req-3b79b028-ab4c-446f-a43f-e870e9e37db9 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Refreshing network info cache for port f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c/disk --force-share --output=json" returned: 0 in 0.450s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-39269c37-ca2d-4650-b0c9-54f73837030a req-416fd7ef-d944-4fad-b480-847df3a35e4a service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-39269c37-ca2d-4650-b0c9-54f73837030a req-416fd7ef-d944-4fad-b480-847df3a35e4a service nova] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-39269c37-ca2d-4650-b0c9-54f73837030a req-416fd7ef-d944-4fad-b480-847df3a35e4a service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-39269c37-ca2d-4650-b0c9-54f73837030a req-416fd7ef-d944-4fad-b480-847df3a35e4a service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-39269c37-ca2d-4650-b0c9-54f73837030a req-416fd7ef-d944-4fad-b480-847df3a35e4a service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] No waiting events found dispatching network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:16:54 user nova-compute[72447]: WARNING nova.compute.manager [req-39269c37-ca2d-4650-b0c9-54f73837030a req-416fd7ef-d944-4fad-b480-847df3a35e4a service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received unexpected event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:16:54 user nova-compute[72447]: DEBUG nova.network.neutron [req-728743f2-fa8e-44e0-bb80-e5339f3ade5e req-3b79b028-ab4c-446f-a43f-e870e9e37db9 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updated VIF entry in instance network info cache for port f276935a-5cfd-4a23-a87e-cbab33adf21e. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG nova.network.neutron [req-728743f2-fa8e-44e0-bb80-e5339f3ade5e req-3b79b028-ab4c-446f-a43f-e870e9e37db9 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updating instance_info_cache with network_info: [{"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:16:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-728743f2-fa8e-44e0-bb80-e5339f3ade5e req-3b79b028-ab4c-446f-a43f-e870e9e37db9 service nova] Releasing lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG nova.compute.manager [req-ab862573-fe26-4af8-a89a-a612c9a03375 req-bff0c506-20f2-433f-b31c-2c2393e70965 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-changed-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG nova.compute.manager [req-ab862573-fe26-4af8-a89a-a612c9a03375 req-bff0c506-20f2-433f-b31c-2c2393e70965 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Refreshing instance network info cache due to event network-changed-f276935a-5cfd-4a23-a87e-cbab33adf21e. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ab862573-fe26-4af8-a89a-a612c9a03375 req-bff0c506-20f2-433f-b31c-2c2393e70965 service nova] Acquiring lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ab862573-fe26-4af8-a89a-a612c9a03375 req-bff0c506-20f2-433f-b31c-2c2393e70965 service nova] Acquired lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:16:55 user nova-compute[72447]: DEBUG nova.network.neutron [req-ab862573-fe26-4af8-a89a-a612c9a03375 req-bff0c506-20f2-433f-b31c-2c2393e70965 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Refreshing network info cache for port f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:16:56 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:16:56 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7132MB free_disk=25.26345443725586GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-01b1fd18-e9d4-4db1-8613-9ec77416b55d req-4568d4a1-b417-4af9-865d-b26f8d06ffa1 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-01b1fd18-e9d4-4db1-8613-9ec77416b55d req-4568d4a1-b417-4af9-865d-b26f8d06ffa1 service nova] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-01b1fd18-e9d4-4db1-8613-9ec77416b55d req-4568d4a1-b417-4af9-865d-b26f8d06ffa1 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-01b1fd18-e9d4-4db1-8613-9ec77416b55d req-4568d4a1-b417-4af9-865d-b26f8d06ffa1 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-01b1fd18-e9d4-4db1-8613-9ec77416b55d req-4568d4a1-b417-4af9-865d-b26f8d06ffa1 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] No waiting events found dispatching network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:16:56 user nova-compute[72447]: WARNING nova.compute.manager [req-01b1fd18-e9d4-4db1-8613-9ec77416b55d req-4568d4a1-b417-4af9-865d-b26f8d06ffa1 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received unexpected event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-01b1fd18-e9d4-4db1-8613-9ec77416b55d req-4568d4a1-b417-4af9-865d-b26f8d06ffa1 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-01b1fd18-e9d4-4db1-8613-9ec77416b55d req-4568d4a1-b417-4af9-865d-b26f8d06ffa1 service nova] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-01b1fd18-e9d4-4db1-8613-9ec77416b55d req-4568d4a1-b417-4af9-865d-b26f8d06ffa1 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-01b1fd18-e9d4-4db1-8613-9ec77416b55d req-4568d4a1-b417-4af9-865d-b26f8d06ffa1 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-01b1fd18-e9d4-4db1-8613-9ec77416b55d req-4568d4a1-b417-4af9-865d-b26f8d06ffa1 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] No waiting events found dispatching network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:16:56 user nova-compute[72447]: WARNING nova.compute.manager [req-01b1fd18-e9d4-4db1-8613-9ec77416b55d req-4568d4a1-b417-4af9-865d-b26f8d06ffa1 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received unexpected event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 700d80d6-9248-4d6f-9010-c3904d8fec2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6c701045-e520-421f-94d2-b54edd0d5c54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2f98bc8b-537a-4b34-85ce-d7baac240046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 92ff498b-1337-47da-aaf1-b5fb9f19e98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance e75d2046-19d7-46b8-9c63-5af205c87c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing inventories for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating ProviderTree inventory for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 12:16:56 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing aggregate associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, aggregates: None {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing trait associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.network.neutron [req-ab862573-fe26-4af8-a89a-a612c9a03375 req-bff0c506-20f2-433f-b31c-2c2393e70965 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updated VIF entry in instance network info cache for port f276935a-5cfd-4a23-a87e-cbab33adf21e. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.network.neutron [req-ab862573-fe26-4af8-a89a-a612c9a03375 req-bff0c506-20f2-433f-b31c-2c2393e70965 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updating instance_info_cache with network_info: [{"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ab862573-fe26-4af8-a89a-a612c9a03375 req-bff0c506-20f2-433f-b31c-2c2393e70965 service nova] Releasing lock "refresh_cache-87bc8e3c-6a96-4466-b6c0-390ba3f662a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805817.2657635, 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:16:57 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] VM Resumed (Lifecycle Event)
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-da3af08f-95ef-4547-8e83-7099d6cdc754 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:16:57 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805817.2667408, 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:16:57 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] VM Started (Lifecycle Event)
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.889s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72447) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 12:16:58 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:58 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:58 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:16:58 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:16:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:17:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:01 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:17:01 user nova-compute[72447]: INFO nova.compute.claims [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Claim successful on node user
Jul 31 12:17:01 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:17:01 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:17:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:17:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:17:01 user nova-compute[72447]: DEBUG nova.network.neutron [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:17:01 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:17:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:17:02 user nova-compute[72447]: INFO nova.virt.block_device [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Booting with volume f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb at /dev/vda
Jul 31 12:17:02 user nova-compute[72447]: DEBUG nova.policy [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0855a22b65634f1690901a5f9be8e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefc91464b24c68a6d7f9059ec58b5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG os_brick.utils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[508ae142-0198-4f7e-b4b3-26466048f518]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ee23fd-a13d-47b3-96ed-f8833b00d38f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebce642-bed0-4780-9ded-ddfb4a09ab52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c0c7e3-feac-40e3-81d6-6f0955ebdde7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:17:02 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:17:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15afda5-25f1-4fa9-8925-741e2fbe15cc]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG os_brick.utils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Updating existing volume attachment record: 18e6ee30-7036-4092-9882-40a7ac8cf0d8 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:17:02 user nova-compute[72447]: DEBUG nova.network.neutron [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Successfully created port: 2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:17:03 user nova-compute[72447]: DEBUG nova.network.neutron [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Successfully updated port: 2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:17:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "refresh_cache-c3a723a9-2a7f-46b9-a326-501d77ad7c16" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:17:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquired lock "refresh_cache-c3a723a9-2a7f-46b9-a326-501d77ad7c16" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:17:03 user nova-compute[72447]: DEBUG nova.network.neutron [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:17:03 user nova-compute[72447]: DEBUG nova.compute.manager [req-f983f40f-10db-41af-95d6-138a69e41a51 req-b78ea851-8747-43b4-8bc3-48665cbc9b53 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event network-changed-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:03 user nova-compute[72447]: DEBUG nova.compute.manager [req-f983f40f-10db-41af-95d6-138a69e41a51 req-b78ea851-8747-43b4-8bc3-48665cbc9b53 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Refreshing instance network info cache due to event network-changed-2b84f682-ff0f-447b-ab90-bc71768a0b31. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:17:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f983f40f-10db-41af-95d6-138a69e41a51 req-b78ea851-8747-43b4-8bc3-48665cbc9b53 service nova] Acquiring lock "refresh_cache-c3a723a9-2a7f-46b9-a326-501d77ad7c16" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:17:03 user nova-compute[72447]: DEBUG nova.network.neutron [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:17:04 user nova-compute[72447]: DEBUG nova.network.neutron [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Updating instance_info_cache with network_info: [{"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:17:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Releasing lock "refresh_cache-c3a723a9-2a7f-46b9-a326-501d77ad7c16" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:17:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Instance network_info: |[{"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:17:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f983f40f-10db-41af-95d6-138a69e41a51 req-b78ea851-8747-43b4-8bc3-48665cbc9b53 service nova] Acquired lock "refresh_cache-c3a723a9-2a7f-46b9-a326-501d77ad7c16" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:17:04 user nova-compute[72447]: DEBUG nova.network.neutron [req-f983f40f-10db-41af-95d6-138a69e41a51 req-b78ea851-8747-43b4-8bc3-48665cbc9b53 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Refreshing network info cache for port 2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:17:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:04 user nova-compute[72447]: DEBUG nova.network.neutron [req-f983f40f-10db-41af-95d6-138a69e41a51 req-b78ea851-8747-43b4-8bc3-48665cbc9b53 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Updated VIF entry in instance network info cache for port 2b84f682-ff0f-447b-ab90-bc71768a0b31. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:17:04 user nova-compute[72447]: DEBUG nova.network.neutron [req-f983f40f-10db-41af-95d6-138a69e41a51 req-b78ea851-8747-43b4-8bc3-48665cbc9b53 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Updating instance_info_cache with network_info: [{"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:17:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f983f40f-10db-41af-95d6-138a69e41a51 req-b78ea851-8747-43b4-8bc3-48665cbc9b53 service nova] Releasing lock "refresh_cache-c3a723a9-2a7f-46b9-a326-501d77ad7c16" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:17:05 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805810.0951037, ba0c6dba-0035-4196-a05f-9335436fac86 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:17:05 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] VM Stopped (Lifecycle Event)
Jul 31 12:17:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-715738d3-4198-40e7-ba7f-e9fbb9a95bb4 None None] [instance: ba0c6dba-0035-4196-a05f-9335436fac86] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:17:09 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Creating image(s)
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Ensure instance console log exists: /opt/stack/data/nova/instances/c3a723a9-2a7f-46b9-a326-501d77ad7c16/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Start _get_guest_xml network_info=[{"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '18e6ee30-7036-4092-9882-40a7ac8cf0d8', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCOzraS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3a723a9-2a7f-46b9-a326-501d77ad7c16', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb', 'serial': 'f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:17:09 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:17:09 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCOzraS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:17:09 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:17:09 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:17:09 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6c2307-a81d-425c-b04e-b9c62ec8dcad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:17:09 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2a57f3-88e9-47a1-b84b-568b947499e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb] added
Jul 31 12:17:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b27afa0-5c85-451e-9c41-c35483a21f31]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e7270d-1af2-46f4-8a3f-de005aa7c223]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUCOzraS {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUCOzraS" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41f071a-6a60-4384-88ff-1cdb967b68c8]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HUCOzraS'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc235881-0a5f-4479-a65e-25e85a2a210a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e412d7-1f23-4fe6-9f0b-5a5f6840c83a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:17:09 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:17:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:17:09 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:17:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9b679b-0192-4f1b-91af-108f6deecff7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260]
Jul 31 12:17:09 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260] successful.
Jul 31 12:17:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d2e114-fd40-4e24-b73b-197dad116391]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e874cc6-285d-4134-92a0-6a7bd344836c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:17:10 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:17:10 user nova-compute[72447]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:17:10 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:17:10 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:17:10 user nova-compute[72447]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:17:10 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc1b0a3-0c65-4085-bd56-75f25d8c9dbe]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCOzraS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:10 user nova-compute[72447]: INFO nova.compute.manager [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Terminating instance
Jul 31 12:17:10 user nova-compute[72447]: DEBUG nova.compute.manager [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-ff24a340-caa7-4ad8-b5ab-27b8a939d443 req-96ffffd1-1d8f-4f46-a69f-d4b830e673da service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Received event network-vif-unplugged-29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ff24a340-caa7-4ad8-b5ab-27b8a939d443 req-96ffffd1-1d8f-4f46-a69f-d4b830e673da service nova] Acquiring lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ff24a340-caa7-4ad8-b5ab-27b8a939d443 req-96ffffd1-1d8f-4f46-a69f-d4b830e673da service nova] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ff24a340-caa7-4ad8-b5ab-27b8a939d443 req-96ffffd1-1d8f-4f46-a69f-d4b830e673da service nova] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-ff24a340-caa7-4ad8-b5ab-27b8a939d443 req-96ffffd1-1d8f-4f46-a69f-d4b830e673da service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] No waiting events found dispatching network-vif-unplugged-29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:17:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-ff24a340-caa7-4ad8-b5ab-27b8a939d443 req-96ffffd1-1d8f-4f46-a69f-d4b830e673da service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Received event network-vif-unplugged-29928bd0-ae23-4a93-ba76-d4df44512908 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23531356231383163', 'path': '/dev/sdc'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531356231383163', 'path': '/dev/sdc'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1455078153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1455078153',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECGXIy4PDnzg6ek+j2HG9HwhyLJVMPlacwsNKl7bNxDhJp0QusrhfASjEy/UNcWcKH7CNfC2QWxQjStvqwQeEecRmaAyf/xqGPScqaT5/FIjyOOce+GAHOyAskfUB7sFg==',key_name='tempest-keypair-1780767399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fefc91464b24c68a6d7f9059ec58b5f',ramdisk_id='',reservation_id='r-fif9fh4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1359270950',owner_user_name='tempest-ServerActionsV293TestJSON-1359270950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855a22b65634f1690901a5f9be8e885',uuid=c3a723a9-2a7f-46b9-a326-501d77ad7c16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converting VIF {"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.objects.instance [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lazy-loading 'pci_devices' on Instance uuid c3a723a9-2a7f-46b9-a326-501d77ad7c16 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:17:11 user nova-compute[72447]:   <uuid>c3a723a9-2a7f-46b9-a326-501d77ad7c16</uuid>
Jul 31 12:17:11 user nova-compute[72447]:   <name>instance-00000013</name>
Jul 31 12:17:11 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:17:11 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:17:11 user nova-compute[72447]:   <metadata>
Jul 31 12:17:11 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:17:11 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:17:11 user nova-compute[72447]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1455078153</nova:name>
Jul 31 12:17:11 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:17:09</nova:creationTime>
Jul 31 12:17:11 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:17:11 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:17:11 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:17:11 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:17:11 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:17:11 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:17:11 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:17:11 user nova-compute[72447]:       <nova:owner>
Jul 31 12:17:11 user nova-compute[72447]:         <nova:user uuid="0855a22b65634f1690901a5f9be8e885">tempest-ServerActionsV293TestJSON-1359270950-project-member</nova:user>
Jul 31 12:17:11 user nova-compute[72447]:         <nova:project uuid="5fefc91464b24c68a6d7f9059ec58b5f">tempest-ServerActionsV293TestJSON-1359270950</nova:project>
Jul 31 12:17:11 user nova-compute[72447]:       </nova:owner>
Jul 31 12:17:11 user nova-compute[72447]:       <nova:ports>
Jul 31 12:17:11 user nova-compute[72447]:         <nova:port uuid="2b84f682-ff0f-447b-ab90-bc71768a0b31">
Jul 31 12:17:11 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 12:17:11 user nova-compute[72447]:         </nova:port>
Jul 31 12:17:11 user nova-compute[72447]:       </nova:ports>
Jul 31 12:17:11 user nova-compute[72447]:     </nova:instance>
Jul 31 12:17:11 user nova-compute[72447]:   </metadata>
Jul 31 12:17:11 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:17:11 user nova-compute[72447]:     <system>
Jul 31 12:17:11 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:17:11 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:17:11 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:17:11 user nova-compute[72447]:       <entry name="serial">c3a723a9-2a7f-46b9-a326-501d77ad7c16</entry>
Jul 31 12:17:11 user nova-compute[72447]:       <entry name="uuid">c3a723a9-2a7f-46b9-a326-501d77ad7c16</entry>
Jul 31 12:17:11 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:17:11 user nova-compute[72447]:     </system>
Jul 31 12:17:11 user nova-compute[72447]:   </sysinfo>
Jul 31 12:17:11 user nova-compute[72447]:   <os>
Jul 31 12:17:11 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:17:11 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:17:11 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:17:11 user nova-compute[72447]:   </os>
Jul 31 12:17:11 user nova-compute[72447]:   <features>
Jul 31 12:17:11 user nova-compute[72447]:     <acpi/>
Jul 31 12:17:11 user nova-compute[72447]:     <apic/>
Jul 31 12:17:11 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:17:11 user nova-compute[72447]:   </features>
Jul 31 12:17:11 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:17:11 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:17:11 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:17:11 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:17:11 user nova-compute[72447]:   </clock>
Jul 31 12:17:11 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:17:11 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:17:11 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:17:11 user nova-compute[72447]:   </cpu>
Jul 31 12:17:11 user nova-compute[72447]:   <devices>
Jul 31 12:17:11 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:17:11 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:17:11 user nova-compute[72447]:       <source dev="/dev/sdc"/>
Jul 31 12:17:11 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:17:11 user nova-compute[72447]:       <serial>f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb</serial>
Jul 31 12:17:11 user nova-compute[72447]:     </disk>
Jul 31 12:17:11 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:17:11 user nova-compute[72447]:       <mac address="fa:16:3e:cb:98:95"/>
Jul 31 12:17:11 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:17:11 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:17:11 user nova-compute[72447]:       <target dev="tap2b84f682-ff"/>
Jul 31 12:17:11 user nova-compute[72447]:     </interface>
Jul 31 12:17:11 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:17:11 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/c3a723a9-2a7f-46b9-a326-501d77ad7c16/console.log" append="off"/>
Jul 31 12:17:11 user nova-compute[72447]:     </serial>
Jul 31 12:17:11 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:17:11 user nova-compute[72447]:     <video>
Jul 31 12:17:11 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:17:11 user nova-compute[72447]:     </video>
Jul 31 12:17:11 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:17:11 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:17:11 user nova-compute[72447]:     </rng>
Jul 31 12:17:11 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:17:11 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:17:11 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:17:11 user nova-compute[72447]:     </memballoon>
Jul 31 12:17:11 user nova-compute[72447]:   </devices>
Jul 31 12:17:11 user nova-compute[72447]: </domain>
Jul 31 12:17:11 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1455078153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1455078153',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECGXIy4PDnzg6ek+j2HG9HwhyLJVMPlacwsNKl7bNxDhJp0QusrhfASjEy/UNcWcKH7CNfC2QWxQjStvqwQeEecRmaAyf/xqGPScqaT5/FIjyOOce+GAHOyAskfUB7sFg==',key_name='tempest-keypair-1780767399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fefc91464b24c68a6d7f9059ec58b5f',ramdisk_id='',reservation_id='r-fif9fh4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1359270950',owner_user_name='tempest-ServerActionsV293TestJSON-1359270950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855a22b65634f1690901a5f9be8e885',uuid=c3a723a9-2a7f-46b9-a326-501d77ad7c16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converting VIF {"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_vif [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b84f682-ff, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b84f682-ff, col_values=(('external_ids', {'iface-id': '2b84f682-ff0f-447b-ab90-bc71768a0b31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:98:95', 'vm-uuid': 'c3a723a9-2a7f-46b9-a326-501d77ad7c16'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:11 user nova-compute[72447]: INFO os_vif [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff')
Jul 31 12:17:11 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Instance destroyed successfully.
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.objects.instance [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lazy-loading 'resources' on Instance uuid 700d80d6-9248-4d6f-9010-c3904d8fec2c {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1232359904',display_name='tempest-TestVolumeSwap-server-1232359904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1232359904',id=8,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2ENTFsk1b8HIVp/AjEQRdBuwHgklGMstN4pfY6/Nxsx2xIO27pLswQtUZ4iPE5KKNau4+ayjWkgCf15tx1cX9NLf4vSR+GwHSqaV2xK6qDVN5umFrWsodM6q65GZ1Qvw==',key_name='tempest-keypair-1410286134',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='639d35cc656e4dae8c062e531e6d2dc4',ramdisk_id='',reservation_id='r-9oc8eyer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-317282149',owner_user_name='tempest-TestVolumeSwap-317282149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b741b81c8ee4de19841fa3ae911bc1c',uuid=700d80d6-9248-4d6f-9010-c3904d8fec2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29928bd0-ae23-4a93-ba76-d4df44512908", "address": "fa:16:3e:35:f3:1f", "network": {"id": "9e4d5fcf-1179-404a-97a7-bf749934d047", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1726752963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639d35cc656e4dae8c062e531e6d2dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29928bd0-ae", "ovs_interfaceid": "29928bd0-ae23-4a93-ba76-d4df44512908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Converting VIF {"id": "29928bd0-ae23-4a93-ba76-d4df44512908", "address": "fa:16:3e:35:f3:1f", "network": {"id": "9e4d5fcf-1179-404a-97a7-bf749934d047", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1726752963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639d35cc656e4dae8c062e531e6d2dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29928bd0-ae", "ovs_interfaceid": "29928bd0-ae23-4a93-ba76-d4df44512908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=29928bd0-ae23-4a93-ba76-d4df44512908,network=Network(9e4d5fcf-1179-404a-97a7-bf749934d047),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29928bd0-ae') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_vif [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=29928bd0-ae23-4a93-ba76-d4df44512908,network=Network(9e4d5fcf-1179-404a-97a7-bf749934d047),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29928bd0-ae') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29928bd0-ae, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:11 user nova-compute[72447]: INFO os_vif [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:f3:1f,bridge_name='br-int',has_traffic_filtering=True,id=29928bd0-ae23-4a93-ba76-d4df44512908,network=Network(9e4d5fcf-1179-404a-97a7-bf749934d047),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29928bd0-ae')
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] No VIF found with MAC fa:16:3e:cb:98:95, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgwWCGcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'a28358f8-4d88-4fc4-a56c-16df5d2b0793'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:17:11 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8eef7b-acc8-4aff-9044-8f50bfa1795d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cb947e-f769-479e-8663-2b5311188ff3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:17:11 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:17:11 user nova-compute[72447]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:17:11 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 (non-flash)
Jul 31 12:17:11 user nova-compute[72447]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:17:11 user nova-compute[72447]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:17:11 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06687b2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793'): ({'sdj'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Removing single pathed devices sdj {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f080c2-ea03-4847-adf3-00c79ce0d68f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[752ab32a-cf53-4766-94a6-8d7911469492]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Flushing IO for device /dev/sdj {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[60091d70-d4a8-4cad-a57a-331002196b17]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.053s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[26522a07-8feb-40a7-be19-a02949eb7414]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] SCSI volumes sdj have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dc61f3-a757-48d3-aff4-03a7dc246cf1]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc5d8cf-a650-480d-a2ba-f1ce31db249c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793, portal: 172.16.0.220,3260]
Jul 31 12:17:11 user nova-compute[72447]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793, portal: 172.16.0.220,3260] successful.
Jul 31 12:17:11 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28358f8-4d88-4fc4-a56c-16df5d2b0793 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6453545-9367-40bc-8010-2ef6134d3934]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] <== disconnect_volume: return (294ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:17:11 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Deleting instance files /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c_del
Jul 31 12:17:11 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Deletion of /opt/stack/data/nova/instances/700d80d6-9248-4d6f-9010-c3904d8fec2c_del complete
Jul 31 12:17:11 user nova-compute[72447]: INFO nova.compute.manager [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Took 1.17 seconds to destroy the instance on the hypervisor.
Jul 31 12:17:11 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:17:11 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:17:12 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Took 0.74 seconds to deallocate network for instance.
Jul 31 12:17:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-f7d16f13-7f7e-4881-911c-c213fba24f49 req-02add99f-a13b-45fd-9bde-33519f0736d4 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Received event network-vif-deleted-29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:12 user nova-compute[72447]: INFO nova.compute.manager [req-f7d16f13-7f7e-4881-911c-c213fba24f49 req-02add99f-a13b-45fd-9bde-33519f0736d4 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Neutron deleted interface 29928bd0-ae23-4a93-ba76-d4df44512908; detaching it from the instance and deleting it from the info cache
Jul 31 12:17:12 user nova-compute[72447]: DEBUG nova.network.neutron [req-f7d16f13-7f7e-4881-911c-c213fba24f49 req-02add99f-a13b-45fd-9bde-33519f0736d4 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-f7d16f13-7f7e-4881-911c-c213fba24f49 req-02add99f-a13b-45fd-9bde-33519f0736d4 service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Detach interface failed, port_id=29928bd0-ae23-4a93-ba76-d4df44512908, reason: Instance 700d80d6-9248-4d6f-9010-c3904d8fec2c could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-a46a6db7-22af-4ac1-8fcb-834a29e4c040 req-b23a51eb-016d-4a56-9b7d-2705f0a9327a service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Received event network-vif-plugged-29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a46a6db7-22af-4ac1-8fcb-834a29e4c040 req-b23a51eb-016d-4a56-9b7d-2705f0a9327a service nova] Acquiring lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a46a6db7-22af-4ac1-8fcb-834a29e4c040 req-b23a51eb-016d-4a56-9b7d-2705f0a9327a service nova] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a46a6db7-22af-4ac1-8fcb-834a29e4c040 req-b23a51eb-016d-4a56-9b7d-2705f0a9327a service nova] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-a46a6db7-22af-4ac1-8fcb-834a29e4c040 req-b23a51eb-016d-4a56-9b7d-2705f0a9327a service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] No waiting events found dispatching network-vif-plugged-29928bd0-ae23-4a93-ba76-d4df44512908 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:17:12 user nova-compute[72447]: WARNING nova.compute.manager [req-a46a6db7-22af-4ac1-8fcb-834a29e4c040 req-b23a51eb-016d-4a56-9b7d-2705f0a9327a service nova] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Received unexpected event network-vif-plugged-29928bd0-ae23-4a93-ba76-d4df44512908 for instance with vm_state active and task_state deleting.
Jul 31 12:17:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-abc32e9d-b336-40c3-a729-ce432cd0835e req-f8d6a9f4-f85c-4e7e-99f9-61631300c122 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-abc32e9d-b336-40c3-a729-ce432cd0835e req-f8d6a9f4-f85c-4e7e-99f9-61631300c122 service nova] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-abc32e9d-b336-40c3-a729-ce432cd0835e req-f8d6a9f4-f85c-4e7e-99f9-61631300c122 service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-abc32e9d-b336-40c3-a729-ce432cd0835e req-f8d6a9f4-f85c-4e7e-99f9-61631300c122 service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-abc32e9d-b336-40c3-a729-ce432cd0835e req-f8d6a9f4-f85c-4e7e-99f9-61631300c122 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] No waiting events found dispatching network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:17:12 user nova-compute[72447]: WARNING nova.compute.manager [req-abc32e9d-b336-40c3-a729-ce432cd0835e req-f8d6a9f4-f85c-4e7e-99f9-61631300c122 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received unexpected event network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 for instance with vm_state building and task_state spawning.
Jul 31 12:17:13 user nova-compute[72447]: INFO nova.compute.manager [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Took 0.75 seconds to detach 1 volumes for instance.
Jul 31 12:17:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:13 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:17:13 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:17:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:13 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Deleted allocations for instance 700d80d6-9248-4d6f-9010-c3904d8fec2c
Jul 31 12:17:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-efbcb4cf-4c2c-40f0-8cf4-b30ba30e9be0 tempest-TestVolumeSwap-317282149 tempest-TestVolumeSwap-317282149-project-member] Lock "700d80d6-9248-4d6f-9010-c3904d8fec2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.211s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805834.6145768, c3a723a9-2a7f-46b9-a326-501d77ad7c16 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:17:14 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] VM Resumed (Lifecycle Event)
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:17:14 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Instance spawned successfully.
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:17:14 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805834.6161225, c3a723a9-2a7f-46b9-a326-501d77ad7c16 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:17:14 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] VM Started (Lifecycle Event)
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:17:14 user nova-compute[72447]: INFO nova.compute.manager [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Took 5.03 seconds to spawn the instance on the hypervisor.
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:14 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:17:14 user nova-compute[72447]: INFO nova.compute.manager [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Took 13.51 seconds to build instance.
Jul 31 12:17:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-7ad9c3d4-4ddb-4484-8421-05d38d938622 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.621s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-2c2404cd-c55e-4b6d-a895-06967d4a87cb req-a597a871-5112-4bc3-98d9-60a2f7c7c8ef service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2c2404cd-c55e-4b6d-a895-06967d4a87cb req-a597a871-5112-4bc3-98d9-60a2f7c7c8ef service nova] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2c2404cd-c55e-4b6d-a895-06967d4a87cb req-a597a871-5112-4bc3-98d9-60a2f7c7c8ef service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2c2404cd-c55e-4b6d-a895-06967d4a87cb req-a597a871-5112-4bc3-98d9-60a2f7c7c8ef service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-2c2404cd-c55e-4b6d-a895-06967d4a87cb req-a597a871-5112-4bc3-98d9-60a2f7c7c8ef service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] No waiting events found dispatching network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:17:14 user nova-compute[72447]: WARNING nova.compute.manager [req-2c2404cd-c55e-4b6d-a895-06967d4a87cb req-a597a871-5112-4bc3-98d9-60a2f7c7c8ef service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received unexpected event network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 for instance with vm_state active and task_state None.
Jul 31 12:17:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:25 user nova-compute[72447]: INFO nova.compute.manager [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Detaching volume 95e9db9e-2f16-4182-93fa-6e4e6c70b6e1
Jul 31 12:17:25 user nova-compute[72447]: INFO nova.virt.block_device [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Attempting to driver detach volume 95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 from mountpoint /dev/vdb
Jul 31 12:17:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Attempting to detach device vdb from instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:17:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:17:25 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:17:25 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:17:25 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:17:25 user nova-compute[72447]:   <serial>95e9db9e-2f16-4182-93fa-6e4e6c70b6e1</serial>
Jul 31 12:17:25 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:17:25 user nova-compute[72447]: </disk>
Jul 31 12:17:25 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:17:25 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Successfully detached device vdb from instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 from the persistent domain config.
Jul 31 12:17:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:17:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:17:25 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:17:25 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:17:25 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:17:25 user nova-compute[72447]:   <serial>95e9db9e-2f16-4182-93fa-6e4e6c70b6e1</serial>
Jul 31 12:17:25 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:17:25 user nova-compute[72447]: </disk>
Jul 31 12:17:25 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805831.1956964, 700d80d6-9248-4d6f-9010-c3904d8fec2c => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:17:26 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] VM Stopped (Lifecycle Event)
Jul 31 12:17:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0985ab5a-88ca-4edb-a56e-3cef06e6fb70 None None] [instance: 700d80d6-9248-4d6f-9010-c3904d8fec2c] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690805846.314857, 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:17:26 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Successfully detached device vdb from instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 from the live domain config.
Jul 31 12:17:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIWJalSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:17:26 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba4dfb3-1501-42be-95f7-0686d07130e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[36103c84-7f51-4271-9bdb-5bc0ba9e795d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:17:26 user nova-compute[72447]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:17:26 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 (non-flash)
Jul 31 12:17:26 user nova-compute[72447]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:17:26 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06711805e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[859c4bc3-1d1e-4920-b8c6-1a74c430f447]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5984c1ca-bb5a-43ee-a3d2-a5972e399c0f]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5901d28-bcee-447f-9ca1-38c6e6451b14]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c8892d-22d5-468b-969e-ec0f6ea54ff7]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5154b920-7285-429a-bfaa-f19f805a966f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a1ae61-4df5-4c9c-b8b2-4cdf89f33adb]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1, portal: 172.16.0.220,3260]
Jul 31 12:17:26 user nova-compute[72447]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1, portal: 172.16.0.220,3260] successful.
Jul 31 12:17:26 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e9db9e-2f16-4182-93fa-6e4e6c70b6e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fef0d91-a1cc-4b4e-a330-61c1f5501705]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] <== disconnect_volume: return (285ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:17:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:17:27 user nova-compute[72447]: DEBUG nova.objects.instance [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'flavor' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:17:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d04412d7-0f0e-4410-a17a-7b137d809265 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.574s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:31 user nova-compute[72447]: INFO nova.compute.manager [None req-d3af7524-14ce-46d4-b525-1da5b808fb59 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Unrescuing
Jul 31 12:17:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d3af7524-14ce-46d4-b525-1da5b808fb59 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:17:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d3af7524-14ce-46d4-b525-1da5b808fb59 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquired lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:17:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-d3af7524-14ce-46d4-b525-1da5b808fb59 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG nova.network.neutron [None req-d3af7524-14ce-46d4-b525-1da5b808fb59 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updating instance_info_cache with network_info: [{"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d3af7524-14ce-46d4-b525-1da5b808fb59 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Releasing lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG nova.objects.instance [None req-d3af7524-14ce-46d4-b525-1da5b808fb59 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'flavor' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG nova.compute.manager [req-b79b253b-39ff-4961-9b35-3b31be9b88fa req-485d0597-e32f-43a6-b7b8-ff7e5ccfb8c6 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-unplugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b79b253b-39ff-4961-9b35-3b31be9b88fa req-485d0597-e32f-43a6-b7b8-ff7e5ccfb8c6 service nova] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b79b253b-39ff-4961-9b35-3b31be9b88fa req-485d0597-e32f-43a6-b7b8-ff7e5ccfb8c6 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b79b253b-39ff-4961-9b35-3b31be9b88fa req-485d0597-e32f-43a6-b7b8-ff7e5ccfb8c6 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG nova.compute.manager [req-b79b253b-39ff-4961-9b35-3b31be9b88fa req-485d0597-e32f-43a6-b7b8-ff7e5ccfb8c6 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] No waiting events found dispatching network-vif-unplugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:17:32 user nova-compute[72447]: WARNING nova.compute.manager [req-b79b253b-39ff-4961-9b35-3b31be9b88fa req-485d0597-e32f-43a6-b7b8-ff7e5ccfb8c6 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received unexpected event network-vif-unplugged-845d0677-fdf6-4de9-abc7-243080eeae50 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:17:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "6c701045-e520-421f-94d2-b54edd0d5c54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:32 user nova-compute[72447]: INFO nova.compute.manager [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Terminating instance
Jul 31 12:17:32 user nova-compute[72447]: DEBUG nova.compute.manager [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:17:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-3134028f-ce20-4ef1-aad8-2f7a136ec560 req-9bd5f402-5eab-4510-ae86-d95d5fad7e8d service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-vif-unplugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3134028f-ce20-4ef1-aad8-2f7a136ec560 req-9bd5f402-5eab-4510-ae86-d95d5fad7e8d service nova] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3134028f-ce20-4ef1-aad8-2f7a136ec560 req-9bd5f402-5eab-4510-ae86-d95d5fad7e8d service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3134028f-ce20-4ef1-aad8-2f7a136ec560 req-9bd5f402-5eab-4510-ae86-d95d5fad7e8d service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-3134028f-ce20-4ef1-aad8-2f7a136ec560 req-9bd5f402-5eab-4510-ae86-d95d5fad7e8d service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] No waiting events found dispatching network-vif-unplugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:17:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-3134028f-ce20-4ef1-aad8-2f7a136ec560 req-9bd5f402-5eab-4510-ae86-d95d5fad7e8d service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-vif-unplugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:17:33 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Instance destroyed successfully.
Jul 31 12:17:34 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Instance destroyed successfully.
Jul 31 12:17:34 user nova-compute[72447]: DEBUG nova.objects.instance [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'resources' on Instance uuid 6c701045-e520-421f-94d2-b54edd0d5c54 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-15178390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-15178390',id=4,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYYPDRHR/gPH/ucT2yXGxpVxqTbPkE2g5ngdBqVVsQXRneiTQFTLKkxDWNoAHE8HulKOLnLKDCHYFWeNIt2FIxpmf8uOCr26dtrpZLq/BxGNXnJIbfPwJnHwEHuDQ42NQ==',key_name='tempest-keypair-2138130535',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8dd0d543cb4786afc39e88f440e538',ramdisk_id='',reservation_id='r-e7ubc06s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1971436108',owner_user_name='tempest-AttachVolumeShelveTestJSON-1971436108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc465160a3a94498ab1aa3aa44280b12',uuid=6c701045-e520-421f-94d2-b54edd0d5c54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converting VIF {"id": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "address": "fa:16:3e:71:0e:50", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c41aee-bb", "ovs_interfaceid": "c9c41aee-bb54-4d97-8f69-9dd65e2c97b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG os_vif [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9c41aee-bb, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:34 user nova-compute[72447]: INFO os_vif [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:0e:50,bridge_name='br-int',has_traffic_filtering=True,id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c41aee-bb')
Jul 31 12:17:34 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Deleting instance files /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54_del
Jul 31 12:17:34 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Deletion of /opt/stack/data/nova/instances/6c701045-e520-421f-94d2-b54edd0d5c54_del complete
Jul 31 12:17:34 user nova-compute[72447]: INFO nova.compute.manager [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Took 1.46 seconds to destroy the instance on the hypervisor.
Jul 31 12:17:34 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-e890f971-997f-439e-8d78-b2517f966c76 req-c238e660-3a63-4286-a47f-fad90d3d334a service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e890f971-997f-439e-8d78-b2517f966c76 req-c238e660-3a63-4286-a47f-fad90d3d334a service nova] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e890f971-997f-439e-8d78-b2517f966c76 req-c238e660-3a63-4286-a47f-fad90d3d334a service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e890f971-997f-439e-8d78-b2517f966c76 req-c238e660-3a63-4286-a47f-fad90d3d334a service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-e890f971-997f-439e-8d78-b2517f966c76 req-c238e660-3a63-4286-a47f-fad90d3d334a service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] No waiting events found dispatching network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:17:34 user nova-compute[72447]: WARNING nova.compute.manager [req-e890f971-997f-439e-8d78-b2517f966c76 req-c238e660-3a63-4286-a47f-fad90d3d334a service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received unexpected event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:17:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-6ebf1812-202d-47bf-8669-d22cb50b45fa req-9e65af7e-9461-4e71-b08d-9447bcc818fd service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6ebf1812-202d-47bf-8669-d22cb50b45fa req-9e65af7e-9461-4e71-b08d-9447bcc818fd service nova] Acquiring lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6ebf1812-202d-47bf-8669-d22cb50b45fa req-9e65af7e-9461-4e71-b08d-9447bcc818fd service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6ebf1812-202d-47bf-8669-d22cb50b45fa req-9e65af7e-9461-4e71-b08d-9447bcc818fd service nova] Lock "6c701045-e520-421f-94d2-b54edd0d5c54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-6ebf1812-202d-47bf-8669-d22cb50b45fa req-9e65af7e-9461-4e71-b08d-9447bcc818fd service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] No waiting events found dispatching network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:17:35 user nova-compute[72447]: WARNING nova.compute.manager [req-6ebf1812-202d-47bf-8669-d22cb50b45fa req-9e65af7e-9461-4e71-b08d-9447bcc818fd service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received unexpected event network-vif-plugged-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 for instance with vm_state active and task_state deleting.
Jul 31 12:17:35 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Took 0.93 seconds to deallocate network for instance.
Jul 31 12:17:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-2e1645a4-2a4e-4e5d-8cf1-f8c7718ba135 req-0aca8aa8-7c05-49d1-b6b3-840503fd0c08 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Received event network-vif-deleted-c9c41aee-bb54-4d97-8f69-9dd65e2c97b7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:35 user nova-compute[72447]: INFO nova.compute.manager [req-2e1645a4-2a4e-4e5d-8cf1-f8c7718ba135 req-0aca8aa8-7c05-49d1-b6b3-840503fd0c08 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Neutron deleted interface c9c41aee-bb54-4d97-8f69-9dd65e2c97b7; detaching it from the instance and deleting it from the info cache
Jul 31 12:17:35 user nova-compute[72447]: DEBUG nova.network.neutron [req-2e1645a4-2a4e-4e5d-8cf1-f8c7718ba135 req-0aca8aa8-7c05-49d1-b6b3-840503fd0c08 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-2e1645a4-2a4e-4e5d-8cf1-f8c7718ba135 req-0aca8aa8-7c05-49d1-b6b3-840503fd0c08 service nova] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Detach interface failed, port_id=c9c41aee-bb54-4d97-8f69-9dd65e2c97b7, reason: Instance 6c701045-e520-421f-94d2-b54edd0d5c54 could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:17:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:35 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Deleted allocations for instance 6c701045-e520-421f-94d2-b54edd0d5c54
Jul 31 12:17:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62f350a3-4a40-41d1-b7a5-0ddf3a65bafe tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "6c701045-e520-421f-94d2-b54edd0d5c54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.927s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-3dd4a282-9775-46b6-abf1-81dd2ccace57 req-d33edf96-0a56-4744-8bf8-d90376fe8eb6 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3dd4a282-9775-46b6-abf1-81dd2ccace57 req-d33edf96-0a56-4744-8bf8-d90376fe8eb6 service nova] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3dd4a282-9775-46b6-abf1-81dd2ccace57 req-d33edf96-0a56-4744-8bf8-d90376fe8eb6 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3dd4a282-9775-46b6-abf1-81dd2ccace57 req-d33edf96-0a56-4744-8bf8-d90376fe8eb6 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-3dd4a282-9775-46b6-abf1-81dd2ccace57 req-d33edf96-0a56-4744-8bf8-d90376fe8eb6 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] No waiting events found dispatching network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:17:36 user nova-compute[72447]: WARNING nova.compute.manager [req-3dd4a282-9775-46b6-abf1-81dd2ccace57 req-d33edf96-0a56-4744-8bf8-d90376fe8eb6 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received unexpected event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:17:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-3dd4a282-9775-46b6-abf1-81dd2ccace57 req-d33edf96-0a56-4744-8bf8-d90376fe8eb6 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3dd4a282-9775-46b6-abf1-81dd2ccace57 req-d33edf96-0a56-4744-8bf8-d90376fe8eb6 service nova] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3dd4a282-9775-46b6-abf1-81dd2ccace57 req-d33edf96-0a56-4744-8bf8-d90376fe8eb6 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3dd4a282-9775-46b6-abf1-81dd2ccace57 req-d33edf96-0a56-4744-8bf8-d90376fe8eb6 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-3dd4a282-9775-46b6-abf1-81dd2ccace57 req-d33edf96-0a56-4744-8bf8-d90376fe8eb6 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] No waiting events found dispatching network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:17:36 user nova-compute[72447]: WARNING nova.compute.manager [req-3dd4a282-9775-46b6-abf1-81dd2ccace57 req-d33edf96-0a56-4744-8bf8-d90376fe8eb6 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received unexpected event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:17:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 981b694a-bf63-4f4b-95c5-bc17aa72b87b due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:17:37 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805857.0591016, 981b694a-bf63-4f4b-95c5-bc17aa72b87b => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:17:37 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] VM Resumed (Lifecycle Event)
Jul 31 12:17:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d3af7524-14ce-46d4-b525-1da5b808fb59 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:17:37 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 12:17:37 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805857.0629737, 981b694a-bf63-4f4b-95c5-bc17aa72b87b => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:17:37 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] VM Started (Lifecycle Event)
Jul 31 12:17:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:17:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:38 user nova-compute[72447]: INFO nova.compute.manager [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] instance snapshotting
Jul 31 12:17:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Beginning live snapshot process
Jul 31 12:17:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json -f qcow2 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json -f qcow2 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.154s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2u32jodj/81f8fc39128240329daa77fbc73c11e7.delta 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2u32jodj/81f8fc39128240329daa77fbc73c11e7.delta 1073741824" returned: 0 in 0.052s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 12:17:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:17:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:17:40 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 12:17:40 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:17:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2u32jodj/81f8fc39128240329daa77fbc73c11e7.delta /opt/stack/data/nova/instances/snapshots/tmp2u32jodj/81f8fc39128240329daa77fbc73c11e7 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2u32jodj/81f8fc39128240329daa77fbc73c11e7.delta /opt/stack/data/nova/instances/snapshots/tmp2u32jodj/81f8fc39128240329daa77fbc73c11e7" returned: 0 in 0.851s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:41 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Snapshot extracted, beginning image upload
Jul 31 12:17:43 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Snapshot image upload complete
Jul 31 12:17:43 user nova-compute[72447]: INFO nova.compute.manager [None req-c584060c-934b-4289-a5da-837a52089ded tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Took 5.54 seconds to snapshot the instance on the hypervisor.
Jul 31 12:17:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "08c02c81-b860-45e8-a4e0-126b2151c601" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "08c02c81-b860-45e8-a4e0-126b2151c601" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:43 user nova-compute[72447]: DEBUG nova.compute.manager [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:17:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:43 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:17:43 user nova-compute[72447]: INFO nova.compute.claims [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Claim successful on node user
Jul 31 12:17:44 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG nova.network.neutron [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:17:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:17:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG nova.policy [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a7feffde0f74f63a6bd027c1958aacb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fad40b5f5e54e7ab9c6f8e78ceb3947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:17:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Creating image(s)
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "/opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "/opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "/opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk 1073741824" returned: 0 in 0.053s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:45 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:17:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:45 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Cannot resize image /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:17:45 user nova-compute[72447]: DEBUG nova.objects.instance [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'migration_context' on Instance uuid 08c02c81-b860-45e8-a4e0-126b2151c601 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:17:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:17:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Ensure instance console log exists: /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:17:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:45 user nova-compute[72447]: DEBUG nova.network.neutron [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Successfully created port: ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Successfully updated port: ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "refresh_cache-08c02c81-b860-45e8-a4e0-126b2151c601" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquired lock "refresh_cache-08c02c81-b860-45e8-a4e0-126b2151c601" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-4930e851-63a5-4ab8-9441-5711fe8c6b2a req-111110fb-9cf6-4615-8400-7d2ab8d801b6 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Received event network-changed-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-4930e851-63a5-4ab8-9441-5711fe8c6b2a req-111110fb-9cf6-4615-8400-7d2ab8d801b6 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Refreshing instance network info cache due to event network-changed-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4930e851-63a5-4ab8-9441-5711fe8c6b2a req-111110fb-9cf6-4615-8400-7d2ab8d801b6 service nova] Acquiring lock "refresh_cache-08c02c81-b860-45e8-a4e0-126b2151c601" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:17:46 user nova-compute[72447]: WARNING nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 00c9825b-0cc3-4c07-87bf-bffaabe4c265 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 2f98bc8b-537a-4b34-85ce-d7baac240046 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 51e36718-ed91-4dc5-82db-1f429df14d2f {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid c3a723a9-2a7f-46b9-a326-501d77ad7c16 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 08c02c81-b860-45e8-a4e0-126b2151c601 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "2f98bc8b-537a-4b34-85ce-d7baac240046" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "51e36718-ed91-4dc5-82db-1f429df14d2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "08c02c81-b860-45e8-a4e0-126b2151c601" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Updating instance_info_cache with network_info: [{"id": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "address": "fa:16:3e:ef:a6:a1", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0af4fb-e6", "ovs_interfaceid": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Releasing lock "refresh_cache-08c02c81-b860-45e8-a4e0-126b2151c601" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Instance network_info: |[{"id": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "address": "fa:16:3e:ef:a6:a1", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0af4fb-e6", "ovs_interfaceid": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4930e851-63a5-4ab8-9441-5711fe8c6b2a req-111110fb-9cf6-4615-8400-7d2ab8d801b6 service nova] Acquired lock "refresh_cache-08c02c81-b860-45e8-a4e0-126b2151c601" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.network.neutron [req-4930e851-63a5-4ab8-9441-5711fe8c6b2a req-111110fb-9cf6-4615-8400-7d2ab8d801b6 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Refreshing network info cache for port ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Start _get_guest_xml network_info=[{"id": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "address": "fa:16:3e:ef:a6:a1", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0af4fb-e6", "ovs_interfaceid": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:17:46 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:17:46 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1158370807',display_name='tempest-AttachVolumeNegativeTest-server-1158370807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1158370807',id=20,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkghjF3MhVzmQ2UwDHqD4+sdLVSilnbco6WCT1cTmqQP2sco2YbmDng6go6PH3sP6QptnGZtxhNKISUZeSg21eiZbFtEoW+nnObRJjhiVWsIWUewiLSNPR1aI6j/9hsmQ==',key_name='tempest-keypair-404129790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fad40b5f5e54e7ab9c6f8e78ceb3947',ramdisk_id='',reservation_id='r-rntfxrto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323727931',owner_user_name='tempest-AttachVolumeNegativeTest-323727931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a7feffde0f74f63a6bd027c1958aacb',uuid=08c02c81-b860-45e8-a4e0-126b2151c601,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "address": "fa:16:3e:ef:a6:a1", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0af4fb-e6", "ovs_interfaceid": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converting VIF {"id": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "address": "fa:16:3e:ef:a6:a1", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0af4fb-e6", "ovs_interfaceid": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=ae0af4fb-e6c1-4711-a186-c8eee0acf7cd,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0af4fb-e6') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'pci_devices' on Instance uuid 08c02c81-b860-45e8-a4e0-126b2151c601 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:17:46 user nova-compute[72447]:   <uuid>08c02c81-b860-45e8-a4e0-126b2151c601</uuid>
Jul 31 12:17:46 user nova-compute[72447]:   <name>instance-00000014</name>
Jul 31 12:17:46 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:17:46 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:17:46 user nova-compute[72447]:   <metadata>
Jul 31 12:17:46 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:17:46 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:17:46 user nova-compute[72447]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1158370807</nova:name>
Jul 31 12:17:46 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:17:46</nova:creationTime>
Jul 31 12:17:46 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:17:46 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:17:46 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:17:46 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:17:46 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:17:46 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:17:46 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:17:46 user nova-compute[72447]:       <nova:owner>
Jul 31 12:17:46 user nova-compute[72447]:         <nova:user uuid="6a7feffde0f74f63a6bd027c1958aacb">tempest-AttachVolumeNegativeTest-323727931-project-member</nova:user>
Jul 31 12:17:46 user nova-compute[72447]:         <nova:project uuid="7fad40b5f5e54e7ab9c6f8e78ceb3947">tempest-AttachVolumeNegativeTest-323727931</nova:project>
Jul 31 12:17:46 user nova-compute[72447]:       </nova:owner>
Jul 31 12:17:46 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:17:46 user nova-compute[72447]:       <nova:ports>
Jul 31 12:17:46 user nova-compute[72447]:         <nova:port uuid="ae0af4fb-e6c1-4711-a186-c8eee0acf7cd">
Jul 31 12:17:46 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 12:17:46 user nova-compute[72447]:         </nova:port>
Jul 31 12:17:46 user nova-compute[72447]:       </nova:ports>
Jul 31 12:17:46 user nova-compute[72447]:     </nova:instance>
Jul 31 12:17:46 user nova-compute[72447]:   </metadata>
Jul 31 12:17:46 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:17:46 user nova-compute[72447]:     <system>
Jul 31 12:17:46 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:17:46 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:17:46 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:17:46 user nova-compute[72447]:       <entry name="serial">08c02c81-b860-45e8-a4e0-126b2151c601</entry>
Jul 31 12:17:46 user nova-compute[72447]:       <entry name="uuid">08c02c81-b860-45e8-a4e0-126b2151c601</entry>
Jul 31 12:17:46 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:17:46 user nova-compute[72447]:     </system>
Jul 31 12:17:46 user nova-compute[72447]:   </sysinfo>
Jul 31 12:17:46 user nova-compute[72447]:   <os>
Jul 31 12:17:46 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:17:46 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:17:46 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:17:46 user nova-compute[72447]:   </os>
Jul 31 12:17:46 user nova-compute[72447]:   <features>
Jul 31 12:17:46 user nova-compute[72447]:     <acpi/>
Jul 31 12:17:46 user nova-compute[72447]:     <apic/>
Jul 31 12:17:46 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:17:46 user nova-compute[72447]:   </features>
Jul 31 12:17:46 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:17:46 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:17:46 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:17:46 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:17:46 user nova-compute[72447]:   </clock>
Jul 31 12:17:46 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:17:46 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:17:46 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:17:46 user nova-compute[72447]:   </cpu>
Jul 31 12:17:46 user nova-compute[72447]:   <devices>
Jul 31 12:17:46 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:17:46 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:17:46 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk"/>
Jul 31 12:17:46 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:17:46 user nova-compute[72447]:     </disk>
Jul 31 12:17:46 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:17:46 user nova-compute[72447]:       <mac address="fa:16:3e:ef:a6:a1"/>
Jul 31 12:17:46 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:17:46 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:17:46 user nova-compute[72447]:       <target dev="tapae0af4fb-e6"/>
Jul 31 12:17:46 user nova-compute[72447]:     </interface>
Jul 31 12:17:46 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:17:46 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/console.log" append="off"/>
Jul 31 12:17:46 user nova-compute[72447]:     </serial>
Jul 31 12:17:46 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:17:46 user nova-compute[72447]:     <video>
Jul 31 12:17:46 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:17:46 user nova-compute[72447]:     </video>
Jul 31 12:17:46 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:17:46 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:17:46 user nova-compute[72447]:     </rng>
Jul 31 12:17:46 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:17:46 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:17:46 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:17:46 user nova-compute[72447]:     </memballoon>
Jul 31 12:17:46 user nova-compute[72447]:   </devices>
Jul 31 12:17:46 user nova-compute[72447]: </domain>
Jul 31 12:17:46 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1158370807',display_name='tempest-AttachVolumeNegativeTest-server-1158370807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1158370807',id=20,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkghjF3MhVzmQ2UwDHqD4+sdLVSilnbco6WCT1cTmqQP2sco2YbmDng6go6PH3sP6QptnGZtxhNKISUZeSg21eiZbFtEoW+nnObRJjhiVWsIWUewiLSNPR1aI6j/9hsmQ==',key_name='tempest-keypair-404129790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fad40b5f5e54e7ab9c6f8e78ceb3947',ramdisk_id='',reservation_id='r-rntfxrto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323727931',owner_user_name='tempest-AttachVolumeNegativeTest-323727931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a7feffde0f74f63a6bd027c1958aacb',uuid=08c02c81-b860-45e8-a4e0-126b2151c601,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "address": "fa:16:3e:ef:a6:a1", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0af4fb-e6", "ovs_interfaceid": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converting VIF {"id": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "address": "fa:16:3e:ef:a6:a1", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0af4fb-e6", "ovs_interfaceid": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=ae0af4fb-e6c1-4711-a186-c8eee0acf7cd,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0af4fb-e6') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG os_vif [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=ae0af4fb-e6c1-4711-a186-c8eee0acf7cd,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0af4fb-e6') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae0af4fb-e6, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae0af4fb-e6, col_values=(('external_ids', {'iface-id': 'ae0af4fb-e6c1-4711-a186-c8eee0acf7cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:a6:a1', 'vm-uuid': '08c02c81-b860-45e8-a4e0-126b2151c601'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:46 user nova-compute[72447]: INFO os_vif [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=ae0af4fb-e6c1-4711-a186-c8eee0acf7cd,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0af4fb-e6')
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:17:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No VIF found with MAC fa:16:3e:ef:a6:a1, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:17:47 user nova-compute[72447]: DEBUG nova.network.neutron [req-4930e851-63a5-4ab8-9441-5711fe8c6b2a req-111110fb-9cf6-4615-8400-7d2ab8d801b6 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Updated VIF entry in instance network info cache for port ae0af4fb-e6c1-4711-a186-c8eee0acf7cd. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:17:47 user nova-compute[72447]: DEBUG nova.network.neutron [req-4930e851-63a5-4ab8-9441-5711fe8c6b2a req-111110fb-9cf6-4615-8400-7d2ab8d801b6 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Updating instance_info_cache with network_info: [{"id": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "address": "fa:16:3e:ef:a6:a1", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0af4fb-e6", "ovs_interfaceid": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:17:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4930e851-63a5-4ab8-9441-5711fe8c6b2a req-111110fb-9cf6-4615-8400-7d2ab8d801b6 service nova] Releasing lock "refresh_cache-08c02c81-b860-45e8-a4e0-126b2151c601" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:17:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-ac5e8903-f5f7-4b05-ae87-c8a15a03734c req-88356b10-0c21-4d1c-acc7-477c0d8719c1 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Received event network-vif-plugged-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ac5e8903-f5f7-4b05-ae87-c8a15a03734c req-88356b10-0c21-4d1c-acc7-477c0d8719c1 service nova] Acquiring lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ac5e8903-f5f7-4b05-ae87-c8a15a03734c req-88356b10-0c21-4d1c-acc7-477c0d8719c1 service nova] Lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ac5e8903-f5f7-4b05-ae87-c8a15a03734c req-88356b10-0c21-4d1c-acc7-477c0d8719c1 service nova] Lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-ac5e8903-f5f7-4b05-ae87-c8a15a03734c req-88356b10-0c21-4d1c-acc7-477c0d8719c1 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] No waiting events found dispatching network-vif-plugged-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:17:48 user nova-compute[72447]: WARNING nova.compute.manager [req-ac5e8903-f5f7-4b05-ae87-c8a15a03734c req-88356b10-0c21-4d1c-acc7-477c0d8719c1 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Received unexpected event network-vif-plugged-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd for instance with vm_state building and task_state spawning.
Jul 31 12:17:48 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:49 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Updating instance_info_cache with network_info: [{"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:17:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:17:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:17:49 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805854.2449183, 6c701045-e520-421f-94d2-b54edd0d5c54 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:17:49 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] VM Stopped (Lifecycle Event)
Jul 31 12:17:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6eca9288-637d-4acd-8c90-5fcfabce0f15 None None] [instance: 6c701045-e520-421f-94d2-b54edd0d5c54] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805870.2843094, 08c02c81-b860-45e8-a4e0-126b2151c601 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:17:50 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] VM Resumed (Lifecycle Event)
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:17:50 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Instance spawned successfully.
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:17:50 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805870.2881095, 08c02c81-b860-45e8-a4e0-126b2151c601 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:17:50 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] VM Started (Lifecycle Event)
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-7096d3ee-08da-448c-9516-4aab6103ae34 req-8ac7f1db-6669-4133-a89f-8c1bdcde102f service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Received event network-vif-plugged-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7096d3ee-08da-448c-9516-4aab6103ae34 req-8ac7f1db-6669-4133-a89f-8c1bdcde102f service nova] Acquiring lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7096d3ee-08da-448c-9516-4aab6103ae34 req-8ac7f1db-6669-4133-a89f-8c1bdcde102f service nova] Lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7096d3ee-08da-448c-9516-4aab6103ae34 req-8ac7f1db-6669-4133-a89f-8c1bdcde102f service nova] Lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-7096d3ee-08da-448c-9516-4aab6103ae34 req-8ac7f1db-6669-4133-a89f-8c1bdcde102f service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] No waiting events found dispatching network-vif-plugged-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:17:50 user nova-compute[72447]: WARNING nova.compute.manager [req-7096d3ee-08da-448c-9516-4aab6103ae34 req-8ac7f1db-6669-4133-a89f-8c1bdcde102f service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Received unexpected event network-vif-plugged-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd for instance with vm_state building and task_state spawning.
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:17:50 user nova-compute[72447]: INFO nova.compute.manager [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Took 5.85 seconds to spawn the instance on the hypervisor.
Jul 31 12:17:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:17:50 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:17:50 user nova-compute[72447]: INFO nova.compute.manager [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Took 6.64 seconds to build instance.
Jul 31 12:17:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8afffe96-4ee5-4fdb-9361-779a9cd7fa3b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "08c02c81-b860-45e8-a4e0-126b2151c601" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.743s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "08c02c81-b860-45e8-a4e0-126b2151c601" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.040s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:50 user nova-compute[72447]: INFO nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:17:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "08c02c81-b860-45e8-a4e0-126b2151c601" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:51 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:17:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:17:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:52 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:17:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:17:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:17:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:17:55 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:17:55 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:17:55 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7283MB free_disk=25.25531005859375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:17:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:17:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2f98bc8b-537a-4b34-85ce-d7baac240046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 92ff498b-1337-47da-aaf1-b5fb9f19e98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance e75d2046-19d7-46b8-9c63-5af205c87c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance c3a723a9-2a7f-46b9-a326-501d77ad7c16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 08c02c81-b860-45e8-a4e0-126b2151c601 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:17:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-eedb9a4f-dbba-45f9-917a-eb92000ba478 req-4f88c408-fb8b-439b-9471-94655803f2cc service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-changed-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-eedb9a4f-dbba-45f9-917a-eb92000ba478 req-4f88c408-fb8b-439b-9471-94655803f2cc service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Refreshing instance network info cache due to event network-changed-fe243daf-4d07-48dd-84c9-1252c65085ed. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-eedb9a4f-dbba-45f9-917a-eb92000ba478 req-4f88c408-fb8b-439b-9471-94655803f2cc service nova] Acquiring lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-eedb9a4f-dbba-45f9-917a-eb92000ba478 req-4f88c408-fb8b-439b-9471-94655803f2cc service nova] Acquired lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG nova.network.neutron [req-eedb9a4f-dbba-45f9-917a-eb92000ba478 req-4f88c408-fb8b-439b-9471-94655803f2cc service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Refreshing network info cache for port fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-127a5005-c8de-4f09-91f0-87bb2abea874 req-a32fc156-96fb-40fc-ada9-d6aae9fa6e8b service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-changed-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-127a5005-c8de-4f09-91f0-87bb2abea874 req-a32fc156-96fb-40fc-ada9-d6aae9fa6e8b service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Refreshing instance network info cache due to event network-changed-8bf862f6-240f-47c4-bf1a-3cf399024ae2. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-127a5005-c8de-4f09-91f0-87bb2abea874 req-a32fc156-96fb-40fc-ada9-d6aae9fa6e8b service nova] Acquiring lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-127a5005-c8de-4f09-91f0-87bb2abea874 req-a32fc156-96fb-40fc-ada9-d6aae9fa6e8b service nova] Acquired lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:17:57 user nova-compute[72447]: DEBUG nova.network.neutron [req-127a5005-c8de-4f09-91f0-87bb2abea874 req-a32fc156-96fb-40fc-ada9-d6aae9fa6e8b service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Refreshing network info cache for port 8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:17:58 user nova-compute[72447]: DEBUG nova.network.neutron [req-eedb9a4f-dbba-45f9-917a-eb92000ba478 req-4f88c408-fb8b-439b-9471-94655803f2cc service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updated VIF entry in instance network info cache for port fe243daf-4d07-48dd-84c9-1252c65085ed. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:17:58 user nova-compute[72447]: DEBUG nova.network.neutron [req-eedb9a4f-dbba-45f9-917a-eb92000ba478 req-4f88c408-fb8b-439b-9471-94655803f2cc service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updating instance_info_cache with network_info: [{"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:17:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-eedb9a4f-dbba-45f9-917a-eb92000ba478 req-4f88c408-fb8b-439b-9471-94655803f2cc service nova] Releasing lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:17:58 user nova-compute[72447]: DEBUG nova.network.neutron [req-127a5005-c8de-4f09-91f0-87bb2abea874 req-a32fc156-96fb-40fc-ada9-d6aae9fa6e8b service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updated VIF entry in instance network info cache for port 8bf862f6-240f-47c4-bf1a-3cf399024ae2. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:17:58 user nova-compute[72447]: DEBUG nova.network.neutron [req-127a5005-c8de-4f09-91f0-87bb2abea874 req-a32fc156-96fb-40fc-ada9-d6aae9fa6e8b service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating instance_info_cache with network_info: [{"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:17:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-127a5005-c8de-4f09-91f0-87bb2abea874 req-a32fc156-96fb-40fc-ada9-d6aae9fa6e8b service nova] Releasing lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:17:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG nova.objects.instance [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'flavor' on Instance uuid e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:20 user nova-compute[72447]: INFO nova.compute.manager [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Attaching volume 9b7d15ea-d519-4598-a858-d87931572ea3 to /dev/vdb
Jul 31 12:18:20 user nova-compute[72447]: DEBUG os_brick.utils [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea29c0f-097b-4228-8be2-987db8134afb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4545629-44e0-4473-aa40-d78baa61ebf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[df49ba6e-2f19-40a7-ba12-7a4c7ec540f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7541a8d7-5970-4130-acd3-c361cc4f1599]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:18:20 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4971d71-db12-429d-bbcc-ddf5641d81d9]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG os_brick.utils [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updating existing volume attachment record: ea9d4fe5-6f12-433d-a044-e3e8ad11ef6d {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:20 user nova-compute[72447]: INFO nova.compute.manager [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Terminating instance
Jul 31 12:18:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-af0827c8-5362-423e-a1af-47f745f009a5 req-c7bed54b-9b5b-4cc2-9313-7c4d9f33b240 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-unplugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af0827c8-5362-423e-a1af-47f745f009a5 req-c7bed54b-9b5b-4cc2-9313-7c4d9f33b240 service nova] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af0827c8-5362-423e-a1af-47f745f009a5 req-c7bed54b-9b5b-4cc2-9313-7c4d9f33b240 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af0827c8-5362-423e-a1af-47f745f009a5 req-c7bed54b-9b5b-4cc2-9313-7c4d9f33b240 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-af0827c8-5362-423e-a1af-47f745f009a5 req-c7bed54b-9b5b-4cc2-9313-7c4d9f33b240 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] No waiting events found dispatching network-vif-unplugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-af0827c8-5362-423e-a1af-47f745f009a5 req-c7bed54b-9b5b-4cc2-9313-7c4d9f33b240 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-unplugged-f276935a-5cfd-4a23-a87e-cbab33adf21e for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:18:21 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Instance destroyed successfully.
Jul 31 12:18:21 user nova-compute[72447]: DEBUG nova.objects.instance [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lazy-loading 'resources' on Instance uuid 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1381244369',display_name='tempest-ServerStableDeviceRescueTest-server-1381244369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1381244369',id=3,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1icZEpEEW/JxHuc33dr3gmsa/8MvvGYu3d89THxX8AOljRfbuMkiO1Klj1CI/oe8u3BcZwF6qZ2IQZEO3QiveEPEKjXw2X6F9Kqdh3YeZyF3J6aXC148RMxGv+f4OePw==',key_name='tempest-keypair-406421083',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:15:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='139411ad75fe4bdf9e858f4260dfa1c9',ramdisk_id='',reservation_id='r-ss8iel63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1013716252',owner_user_name='tempest-ServerStableDeviceRescueTest-1013716252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:16:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de2fa3b70ec747628afaf3c707e6d5ca',uuid=87bc8e3c-6a96-4466-b6c0-390ba3f662a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Converting VIF {"id": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "address": "fa:16:3e:d4:43:3e", "network": {"id": "8876bd0f-8dd8-4fc8-bb2d-98c58e43afec", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1073197483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "139411ad75fe4bdf9e858f4260dfa1c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf276935a-5c", "ovs_interfaceid": "f276935a-5cfd-4a23-a87e-cbab33adf21e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:43:3e,bridge_name='br-int',has_traffic_filtering=True,id=f276935a-5cfd-4a23-a87e-cbab33adf21e,network=Network(8876bd0f-8dd8-4fc8-bb2d-98c58e43afec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf276935a-5c') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG os_vif [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:43:3e,bridge_name='br-int',has_traffic_filtering=True,id=f276935a-5cfd-4a23-a87e-cbab33adf21e,network=Network(8876bd0f-8dd8-4fc8-bb2d-98c58e43afec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf276935a-5c') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf276935a-5c, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:18:21 user nova-compute[72447]: INFO os_vif [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:43:3e,bridge_name='br-int',has_traffic_filtering=True,id=f276935a-5cfd-4a23-a87e-cbab33adf21e,network=Network(8876bd0f-8dd8-4fc8-bb2d-98c58e43afec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf276935a-5c')
Jul 31 12:18:21 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Deleting instance files /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4_del
Jul 31 12:18:21 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Deletion of /opt/stack/data/nova/instances/87bc8e3c-6a96-4466-b6c0-390ba3f662a4_del complete
Jul 31 12:18:21 user nova-compute[72447]: INFO nova.compute.manager [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 31 12:18:21 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:18:21 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:18:22 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:22 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Took 1.02 seconds to deallocate network for instance.
Jul 31 12:18:22 user nova-compute[72447]: DEBUG nova.compute.manager [req-6937977f-30c1-4848-b25a-f2166e81eb9b req-e821b98c-748f-4c93-89f6-055da620db94 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-deleted-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:22 user nova-compute[72447]: INFO nova.compute.manager [req-6937977f-30c1-4848-b25a-f2166e81eb9b req-e821b98c-748f-4c93-89f6-055da620db94 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Neutron deleted interface f276935a-5cfd-4a23-a87e-cbab33adf21e; detaching it from the instance and deleting it from the info cache
Jul 31 12:18:22 user nova-compute[72447]: DEBUG nova.network.neutron [req-6937977f-30c1-4848-b25a-f2166e81eb9b req-e821b98c-748f-4c93-89f6-055da620db94 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:22 user nova-compute[72447]: DEBUG nova.compute.manager [req-6937977f-30c1-4848-b25a-f2166e81eb9b req-e821b98c-748f-4c93-89f6-055da620db94 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Detach interface failed, port_id=f276935a-5cfd-4a23-a87e-cbab33adf21e, reason: Instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:18:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:23 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:18:23 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:18:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:23 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Deleted allocations for instance 87bc8e3c-6a96-4466-b6c0-390ba3f662a4
Jul 31 12:18:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8f50131f-a65b-4962-9c7b-d8cab21dc1f4 tempest-ServerStableDeviceRescueTest-1013716252 tempest-ServerStableDeviceRescueTest-1013716252-project-member] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.483s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-405763b9-c675-4dc0-9be9-0903724bfe2e req-f5a6cab7-64ad-41f3-964d-45da2cc39264 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-405763b9-c675-4dc0-9be9-0903724bfe2e req-f5a6cab7-64ad-41f3-964d-45da2cc39264 service nova] Acquiring lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-405763b9-c675-4dc0-9be9-0903724bfe2e req-f5a6cab7-64ad-41f3-964d-45da2cc39264 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-405763b9-c675-4dc0-9be9-0903724bfe2e req-f5a6cab7-64ad-41f3-964d-45da2cc39264 service nova] Lock "87bc8e3c-6a96-4466-b6c0-390ba3f662a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-405763b9-c675-4dc0-9be9-0903724bfe2e req-f5a6cab7-64ad-41f3-964d-45da2cc39264 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] No waiting events found dispatching network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:18:23 user nova-compute[72447]: WARNING nova.compute.manager [req-405763b9-c675-4dc0-9be9-0903724bfe2e req-f5a6cab7-64ad-41f3-964d-45da2cc39264 service nova] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Received unexpected event network-vif-plugged-f276935a-5cfd-4a23-a87e-cbab33adf21e for instance with vm_state deleted and task_state None.
Jul 31 12:18:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "87220d5b-df7b-4664-a5e8-088157130701" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:18:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:27 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:18:27 user nova-compute[72447]: INFO nova.compute.claims [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Claim successful on node user
Jul 31 12:18:27 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:18:27 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:18:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.network.neutron [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:18:28 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.policy [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc465160a3a94498ab1aa3aa44280b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8dd0d543cb4786afc39e88f440e538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:18:28 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Creating image(s)
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "/opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "/opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "/opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkgrlMum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:18:28 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:18:28 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:18:28 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk 1073741824" returned: 0 in 0.063s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b99fdca-93e3-4f2d-b861-7cedbc88bae1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:18:28 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22cac72-3c66-475a-99aa-ca1a03e63bc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3] added
Jul 31 12:18:28 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c0c72e-5854-42d3-8807-a14f43149eb6]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[857b79f4-304b-436d-a918-ad541e4fbf07]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RkgrlMum {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RkgrlMum" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fc66ad-262e-47a6-9a50-15e181eef697]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RkgrlMum'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.150s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15fde42-515c-4478-887e-12336dcd825e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d19bac-5e4e-4420-8e5a-30a1ed837b50]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:18:28 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:18:28 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc42f81a-b455-4c43-9857-e504688cc5c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260]
Jul 31 12:18:28 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260] successful.
Jul 31 12:18:28 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[08be5654-4ecf-440d-bc48-745a4d9b658d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdbc481-3692-408a-b3e1-c2b66051ec9c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:18:28 user nova-compute[72447]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:18:28 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:18:28 user nova-compute[72447]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:18:28 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Cannot resize image /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.objects.instance [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'migration_context' on Instance uuid 87220d5b-df7b-4664-a5e8-088157130701 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Ensure instance console log exists: /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[473a7902-0465-45f2-990c-257b28fb1410]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkgrlMum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:18:28 user nova-compute[72447]: DEBUG nova.network.neutron [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Successfully created port: fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:18:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:18:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26637643035623132', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:18:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637643035623132', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:18:29 user nova-compute[72447]: DEBUG nova.objects.instance [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'flavor' on Instance uuid e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:18:29 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:18:29 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:18:29 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:18:29 user nova-compute[72447]:   <serial>9b7d15ea-d519-4598-a858-d87931572ea3</serial>
Jul 31 12:18:29 user nova-compute[72447]: </disk>
Jul 31 12:18:29 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.network.neutron [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Successfully updated port: fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquired lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.network.neutron [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-9c4e5201-69a2-4783-80fc-7d4af6af8820 req-eb15fbf6-5b19-4467-bcc6-46cc639c4698 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-changed-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-9c4e5201-69a2-4783-80fc-7d4af6af8820 req-eb15fbf6-5b19-4467-bcc6-46cc639c4698 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Refreshing instance network info cache due to event network-changed-fcf8adb7-881f-403d-bc7b-27a782db1dd5. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9c4e5201-69a2-4783-80fc-7d4af6af8820 req-eb15fbf6-5b19-4467-bcc6-46cc639c4698 service nova] Acquiring lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.network.neutron [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] No VIF found with MAC fa:16:3e:9a:97:2f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-23758b7b-5918-4659-a8a8-6d028cbee958 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.363s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.network.neutron [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Updating instance_info_cache with network_info: [{"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Releasing lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Instance network_info: |[{"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9c4e5201-69a2-4783-80fc-7d4af6af8820 req-eb15fbf6-5b19-4467-bcc6-46cc639c4698 service nova] Acquired lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.network.neutron [req-9c4e5201-69a2-4783-80fc-7d4af6af8820 req-eb15fbf6-5b19-4467-bcc6-46cc639c4698 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Refreshing network info cache for port fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Start _get_guest_xml network_info=[{"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:18:30 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:18:30 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1809185140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1809185140',id=21,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsjkp3AZodxtBxsAt/VOiQNsOssof0791bnDw6kXo1qalLZuixWZDfUdE+7iSVjIKO/vnIxlJCZuB5Blyb4/Bx18cIDvjWLFw43QhuekDLT5oFcsVtn2OfEKnZpzCXqjA==',key_name='tempest-keypair-1672108798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8dd0d543cb4786afc39e88f440e538',ramdisk_id='',reservation_id='r-fx3n0x08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1971436108',owner_user_name='tempest-AttachVolumeShelveTestJSON-1971436108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc465160a3a94498ab1aa3aa44280b12',uuid=87220d5b-df7b-4664-a5e8-088157130701,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converting VIF {"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.objects.instance [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'pci_devices' on Instance uuid 87220d5b-df7b-4664-a5e8-088157130701 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:18:30 user nova-compute[72447]:   <uuid>87220d5b-df7b-4664-a5e8-088157130701</uuid>
Jul 31 12:18:30 user nova-compute[72447]:   <name>instance-00000015</name>
Jul 31 12:18:30 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:18:30 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:18:30 user nova-compute[72447]:   <metadata>
Jul 31 12:18:30 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:18:30 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:18:30 user nova-compute[72447]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1809185140</nova:name>
Jul 31 12:18:30 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:18:30</nova:creationTime>
Jul 31 12:18:30 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:18:30 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:18:30 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:18:30 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:18:30 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:18:30 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:18:30 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:18:30 user nova-compute[72447]:       <nova:owner>
Jul 31 12:18:30 user nova-compute[72447]:         <nova:user uuid="cc465160a3a94498ab1aa3aa44280b12">tempest-AttachVolumeShelveTestJSON-1971436108-project-member</nova:user>
Jul 31 12:18:30 user nova-compute[72447]:         <nova:project uuid="8b8dd0d543cb4786afc39e88f440e538">tempest-AttachVolumeShelveTestJSON-1971436108</nova:project>
Jul 31 12:18:30 user nova-compute[72447]:       </nova:owner>
Jul 31 12:18:30 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:18:30 user nova-compute[72447]:       <nova:ports>
Jul 31 12:18:30 user nova-compute[72447]:         <nova:port uuid="fcf8adb7-881f-403d-bc7b-27a782db1dd5">
Jul 31 12:18:30 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 12:18:30 user nova-compute[72447]:         </nova:port>
Jul 31 12:18:30 user nova-compute[72447]:       </nova:ports>
Jul 31 12:18:30 user nova-compute[72447]:     </nova:instance>
Jul 31 12:18:30 user nova-compute[72447]:   </metadata>
Jul 31 12:18:30 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:18:30 user nova-compute[72447]:     <system>
Jul 31 12:18:30 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:18:30 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:18:30 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:18:30 user nova-compute[72447]:       <entry name="serial">87220d5b-df7b-4664-a5e8-088157130701</entry>
Jul 31 12:18:30 user nova-compute[72447]:       <entry name="uuid">87220d5b-df7b-4664-a5e8-088157130701</entry>
Jul 31 12:18:30 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:18:30 user nova-compute[72447]:     </system>
Jul 31 12:18:30 user nova-compute[72447]:   </sysinfo>
Jul 31 12:18:30 user nova-compute[72447]:   <os>
Jul 31 12:18:30 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:18:30 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:18:30 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:18:30 user nova-compute[72447]:   </os>
Jul 31 12:18:30 user nova-compute[72447]:   <features>
Jul 31 12:18:30 user nova-compute[72447]:     <acpi/>
Jul 31 12:18:30 user nova-compute[72447]:     <apic/>
Jul 31 12:18:30 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:18:30 user nova-compute[72447]:   </features>
Jul 31 12:18:30 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:18:30 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:18:30 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:18:30 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:18:30 user nova-compute[72447]:   </clock>
Jul 31 12:18:30 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:18:30 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:18:30 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:18:30 user nova-compute[72447]:   </cpu>
Jul 31 12:18:30 user nova-compute[72447]:   <devices>
Jul 31 12:18:30 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:18:30 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:18:30 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk"/>
Jul 31 12:18:30 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:18:30 user nova-compute[72447]:     </disk>
Jul 31 12:18:30 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:18:30 user nova-compute[72447]:       <mac address="fa:16:3e:34:5b:8d"/>
Jul 31 12:18:30 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:18:30 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:18:30 user nova-compute[72447]:       <target dev="tapfcf8adb7-88"/>
Jul 31 12:18:30 user nova-compute[72447]:     </interface>
Jul 31 12:18:30 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:18:30 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/console.log" append="off"/>
Jul 31 12:18:30 user nova-compute[72447]:     </serial>
Jul 31 12:18:30 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:18:30 user nova-compute[72447]:     <video>
Jul 31 12:18:30 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:18:30 user nova-compute[72447]:     </video>
Jul 31 12:18:30 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:18:30 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:18:30 user nova-compute[72447]:     </rng>
Jul 31 12:18:30 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:18:30 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:18:30 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:18:30 user nova-compute[72447]:     </memballoon>
Jul 31 12:18:30 user nova-compute[72447]:   </devices>
Jul 31 12:18:30 user nova-compute[72447]: </domain>
Jul 31 12:18:30 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1809185140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1809185140',id=21,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsjkp3AZodxtBxsAt/VOiQNsOssof0791bnDw6kXo1qalLZuixWZDfUdE+7iSVjIKO/vnIxlJCZuB5Blyb4/Bx18cIDvjWLFw43QhuekDLT5oFcsVtn2OfEKnZpzCXqjA==',key_name='tempest-keypair-1672108798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8dd0d543cb4786afc39e88f440e538',ramdisk_id='',reservation_id='r-fx3n0x08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1971436108',owner_user_name='tempest-AttachVolumeShelveTestJSON-1971436108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc465160a3a94498ab1aa3aa44280b12',uuid=87220d5b-df7b-4664-a5e8-088157130701,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converting VIF {"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG os_vif [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcf8adb7-88, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcf8adb7-88, col_values=(('external_ids', {'iface-id': 'fcf8adb7-881f-403d-bc7b-27a782db1dd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:5b:8d', 'vm-uuid': '87220d5b-df7b-4664-a5e8-088157130701'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:30 user nova-compute[72447]: INFO os_vif [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88')
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:18:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] No VIF found with MAC fa:16:3e:34:5b:8d, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:18:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-9c4e5201-69a2-4783-80fc-7d4af6af8820 req-eb15fbf6-5b19-4467-bcc6-46cc639c4698 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Updated VIF entry in instance network info cache for port fcf8adb7-881f-403d-bc7b-27a782db1dd5. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:18:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-9c4e5201-69a2-4783-80fc-7d4af6af8820 req-eb15fbf6-5b19-4467-bcc6-46cc639c4698 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Updating instance_info_cache with network_info: [{"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9c4e5201-69a2-4783-80fc-7d4af6af8820 req-eb15fbf6-5b19-4467-bcc6-46cc639c4698 service nova] Releasing lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:18:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:32 user nova-compute[72447]: DEBUG nova.compute.manager [req-86e9619c-724e-4665-9a93-5abc018092cb req-42ebb5f2-7379-44a5-9352-c171a7b48b72 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-86e9619c-724e-4665-9a93-5abc018092cb req-42ebb5f2-7379-44a5-9352-c171a7b48b72 service nova] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-86e9619c-724e-4665-9a93-5abc018092cb req-42ebb5f2-7379-44a5-9352-c171a7b48b72 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-86e9619c-724e-4665-9a93-5abc018092cb req-42ebb5f2-7379-44a5-9352-c171a7b48b72 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:32 user nova-compute[72447]: DEBUG nova.compute.manager [req-86e9619c-724e-4665-9a93-5abc018092cb req-42ebb5f2-7379-44a5-9352-c171a7b48b72 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] No waiting events found dispatching network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:18:32 user nova-compute[72447]: WARNING nova.compute.manager [req-86e9619c-724e-4665-9a93-5abc018092cb req-42ebb5f2-7379-44a5-9352-c171a7b48b72 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received unexpected event network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 for instance with vm_state building and task_state spawning.
Jul 31 12:18:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805914.4687486, 87220d5b-df7b-4664-a5e8-088157130701 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:18:34 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] VM Resumed (Lifecycle Event)
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:18:34 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Instance spawned successfully.
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:18:34 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805914.4695888, 87220d5b-df7b-4664-a5e8-088157130701 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:18:34 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] VM Started (Lifecycle Event)
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:18:34 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-0a0dbe76-c12b-4b1b-aa3c-a050566e17b6 req-d9713c6b-83ef-4dc7-a513-280d7d846d43 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0a0dbe76-c12b-4b1b-aa3c-a050566e17b6 req-d9713c6b-83ef-4dc7-a513-280d7d846d43 service nova] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0a0dbe76-c12b-4b1b-aa3c-a050566e17b6 req-d9713c6b-83ef-4dc7-a513-280d7d846d43 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0a0dbe76-c12b-4b1b-aa3c-a050566e17b6 req-d9713c6b-83ef-4dc7-a513-280d7d846d43 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-0a0dbe76-c12b-4b1b-aa3c-a050566e17b6 req-d9713c6b-83ef-4dc7-a513-280d7d846d43 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] No waiting events found dispatching network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:18:34 user nova-compute[72447]: WARNING nova.compute.manager [req-0a0dbe76-c12b-4b1b-aa3c-a050566e17b6 req-d9713c6b-83ef-4dc7-a513-280d7d846d43 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received unexpected event network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 for instance with vm_state building and task_state spawning.
Jul 31 12:18:34 user nova-compute[72447]: INFO nova.compute.manager [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Took 6.45 seconds to spawn the instance on the hypervisor.
Jul 31 12:18:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:18:34 user nova-compute[72447]: INFO nova.compute.manager [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Took 7.23 seconds to build instance.
Jul 31 12:18:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9ad46cd7-3c71-48cc-ad5e-09930bdfc931 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "87220d5b-df7b-4664-a5e8-088157130701" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.382s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:36 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805901.6259964, 87bc8e3c-6a96-4466-b6c0-390ba3f662a4 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:18:36 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] VM Stopped (Lifecycle Event)
Jul 31 12:18:36 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c17b1560-a38b-4764-b3f4-cd5f1ab187fd None None] [instance: 87bc8e3c-6a96-4466-b6c0-390ba3f662a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:18:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:18:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:37 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:18:37 user nova-compute[72447]: INFO nova.compute.claims [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Claim successful on node user
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-1518358e-f15a-4f51-852c-66c2a7a4467e req-5a562e4a-8cd7-4543-82a2-6a8b3642d616 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-changed-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-1518358e-f15a-4f51-852c-66c2a7a4467e req-5a562e4a-8cd7-4543-82a2-6a8b3642d616 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Refreshing instance network info cache due to event network-changed-c491e329-e20e-47e6-893a-7643968aba7e. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1518358e-f15a-4f51-852c-66c2a7a4467e req-5a562e4a-8cd7-4543-82a2-6a8b3642d616 service nova] Acquiring lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1518358e-f15a-4f51-852c-66c2a7a4467e req-5a562e4a-8cd7-4543-82a2-6a8b3642d616 service nova] Acquired lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.network.neutron [req-1518358e-f15a-4f51-852c-66c2a7a4467e req-5a562e4a-8cd7-4543-82a2-6a8b3642d616 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Refreshing network info cache for port c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:18:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.policy [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ead2fe8321b41be8bfc78f2bd5a036b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3110024c6d94eff885a84c59a01a85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:18:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Creating image(s)
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "/opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "/opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "/opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.network.neutron [req-1518358e-f15a-4f51-852c-66c2a7a4467e req-5a562e4a-8cd7-4543-82a2-6a8b3642d616 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updated VIF entry in instance network info cache for port c491e329-e20e-47e6-893a-7643968aba7e. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG nova.network.neutron [req-1518358e-f15a-4f51-852c-66c2a7a4467e req-5a562e4a-8cd7-4543-82a2-6a8b3642d616 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updating instance_info_cache with network_info: [{"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1518358e-f15a-4f51-852c-66c2a7a4467e req-5a562e4a-8cd7-4543-82a2-6a8b3642d616 service nova] Releasing lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk 1073741824" returned: 0 in 0.059s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.196s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Successfully created port: cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Cannot resize image /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lazy-loading 'migration_context' on Instance uuid b291ba57-9fdb-48f2-ac0c-45a108dda3b1 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Ensure instance console log exists: /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:40 user nova-compute[72447]: DEBUG nova.compute.manager [req-2b6b0f7e-12dc-4250-80d2-9a0cc4b9d1f5 req-e4268ccc-ead7-4370-980a-5ed451a56d62 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-changed-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:40 user nova-compute[72447]: DEBUG nova.compute.manager [req-2b6b0f7e-12dc-4250-80d2-9a0cc4b9d1f5 req-e4268ccc-ead7-4370-980a-5ed451a56d62 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Refreshing instance network info cache due to event network-changed-c491e329-e20e-47e6-893a-7643968aba7e. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:18:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2b6b0f7e-12dc-4250-80d2-9a0cc4b9d1f5 req-e4268ccc-ead7-4370-980a-5ed451a56d62 service nova] Acquiring lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:18:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2b6b0f7e-12dc-4250-80d2-9a0cc4b9d1f5 req-e4268ccc-ead7-4370-980a-5ed451a56d62 service nova] Acquired lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:18:40 user nova-compute[72447]: DEBUG nova.network.neutron [req-2b6b0f7e-12dc-4250-80d2-9a0cc4b9d1f5 req-e4268ccc-ead7-4370-980a-5ed451a56d62 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Refreshing network info cache for port c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:18:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Successfully updated port: cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "refresh_cache-b291ba57-9fdb-48f2-ac0c-45a108dda3b1" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquired lock "refresh_cache-b291ba57-9fdb-48f2-ac0c-45a108dda3b1" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.network.neutron [req-2b6b0f7e-12dc-4250-80d2-9a0cc4b9d1f5 req-e4268ccc-ead7-4370-980a-5ed451a56d62 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updated VIF entry in instance network info cache for port c491e329-e20e-47e6-893a-7643968aba7e. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.network.neutron [req-2b6b0f7e-12dc-4250-80d2-9a0cc4b9d1f5 req-e4268ccc-ead7-4370-980a-5ed451a56d62 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updating instance_info_cache with network_info: [{"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2b6b0f7e-12dc-4250-80d2-9a0cc4b9d1f5 req-e4268ccc-ead7-4370-980a-5ed451a56d62 service nova] Releasing lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Updating instance_info_cache with network_info: [{"id": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "address": "fa:16:3e:59:1a:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd04ddb5-46", "ovs_interfaceid": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Releasing lock "refresh_cache-b291ba57-9fdb-48f2-ac0c-45a108dda3b1" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Instance network_info: |[{"id": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "address": "fa:16:3e:59:1a:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd04ddb5-46", "ovs_interfaceid": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Start _get_guest_xml network_info=[{"id": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "address": "fa:16:3e:59:1a:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd04ddb5-46", "ovs_interfaceid": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:18:41 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:18:41 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1458018657',display_name='tempest-VolumesAdminNegativeTest-server-1458018657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1458018657',id=22,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6gGsgHf+u6je3fi5pWRspe4+1YTnpK5hZvO8sUwujpYUpFmmvlxOMD5JFWNVDMpu2iD/kmIgb11TZGP3796bpNESzn0aILceRSguMB3asFulMT8qlvL2kj+wmGJcWUhQ==',key_name='tempest-keypair-2024619754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3110024c6d94eff885a84c59a01a85c',ramdisk_id='',reservation_id='r-dg2dw1ts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-420445056',owner_user_name='tempest-VolumesAdminNegativeTest-420445056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ead2fe8321b41be8bfc78f2bd5a036b',uuid=b291ba57-9fdb-48f2-ac0c-45a108dda3b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "address": "fa:16:3e:59:1a:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd04ddb5-46", "ovs_interfaceid": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Converting VIF {"id": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "address": "fa:16:3e:59:1a:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd04ddb5-46", "ovs_interfaceid": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:1a:27,bridge_name='br-int',has_traffic_filtering=True,id=cd04ddb5-4657-4e58-b422-7431d46e9ab5,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd04ddb5-46') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lazy-loading 'pci_devices' on Instance uuid b291ba57-9fdb-48f2-ac0c-45a108dda3b1 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:18:41 user nova-compute[72447]:   <uuid>b291ba57-9fdb-48f2-ac0c-45a108dda3b1</uuid>
Jul 31 12:18:41 user nova-compute[72447]:   <name>instance-00000016</name>
Jul 31 12:18:41 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:18:41 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:18:41 user nova-compute[72447]:   <metadata>
Jul 31 12:18:41 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:18:41 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:18:41 user nova-compute[72447]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1458018657</nova:name>
Jul 31 12:18:41 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:18:41</nova:creationTime>
Jul 31 12:18:41 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:18:41 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:18:41 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:18:41 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:18:41 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:18:41 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:18:41 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:18:41 user nova-compute[72447]:       <nova:owner>
Jul 31 12:18:41 user nova-compute[72447]:         <nova:user uuid="1ead2fe8321b41be8bfc78f2bd5a036b">tempest-VolumesAdminNegativeTest-420445056-project-member</nova:user>
Jul 31 12:18:41 user nova-compute[72447]:         <nova:project uuid="e3110024c6d94eff885a84c59a01a85c">tempest-VolumesAdminNegativeTest-420445056</nova:project>
Jul 31 12:18:41 user nova-compute[72447]:       </nova:owner>
Jul 31 12:18:41 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:18:41 user nova-compute[72447]:       <nova:ports>
Jul 31 12:18:41 user nova-compute[72447]:         <nova:port uuid="cd04ddb5-4657-4e58-b422-7431d46e9ab5">
Jul 31 12:18:41 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 12:18:41 user nova-compute[72447]:         </nova:port>
Jul 31 12:18:41 user nova-compute[72447]:       </nova:ports>
Jul 31 12:18:41 user nova-compute[72447]:     </nova:instance>
Jul 31 12:18:41 user nova-compute[72447]:   </metadata>
Jul 31 12:18:41 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:18:41 user nova-compute[72447]:     <system>
Jul 31 12:18:41 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:18:41 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:18:41 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:18:41 user nova-compute[72447]:       <entry name="serial">b291ba57-9fdb-48f2-ac0c-45a108dda3b1</entry>
Jul 31 12:18:41 user nova-compute[72447]:       <entry name="uuid">b291ba57-9fdb-48f2-ac0c-45a108dda3b1</entry>
Jul 31 12:18:41 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:18:41 user nova-compute[72447]:     </system>
Jul 31 12:18:41 user nova-compute[72447]:   </sysinfo>
Jul 31 12:18:41 user nova-compute[72447]:   <os>
Jul 31 12:18:41 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:18:41 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:18:41 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:18:41 user nova-compute[72447]:   </os>
Jul 31 12:18:41 user nova-compute[72447]:   <features>
Jul 31 12:18:41 user nova-compute[72447]:     <acpi/>
Jul 31 12:18:41 user nova-compute[72447]:     <apic/>
Jul 31 12:18:41 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:18:41 user nova-compute[72447]:   </features>
Jul 31 12:18:41 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:18:41 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:18:41 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:18:41 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:18:41 user nova-compute[72447]:   </clock>
Jul 31 12:18:41 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:18:41 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:18:41 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:18:41 user nova-compute[72447]:   </cpu>
Jul 31 12:18:41 user nova-compute[72447]:   <devices>
Jul 31 12:18:41 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:18:41 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:18:41 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk"/>
Jul 31 12:18:41 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:18:41 user nova-compute[72447]:     </disk>
Jul 31 12:18:41 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:18:41 user nova-compute[72447]:       <mac address="fa:16:3e:59:1a:27"/>
Jul 31 12:18:41 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:18:41 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:18:41 user nova-compute[72447]:       <target dev="tapcd04ddb5-46"/>
Jul 31 12:18:41 user nova-compute[72447]:     </interface>
Jul 31 12:18:41 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:18:41 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/console.log" append="off"/>
Jul 31 12:18:41 user nova-compute[72447]:     </serial>
Jul 31 12:18:41 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:18:41 user nova-compute[72447]:     <video>
Jul 31 12:18:41 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:18:41 user nova-compute[72447]:     </video>
Jul 31 12:18:41 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:18:41 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:18:41 user nova-compute[72447]:     </rng>
Jul 31 12:18:41 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:18:41 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:18:41 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:18:41 user nova-compute[72447]:     </memballoon>
Jul 31 12:18:41 user nova-compute[72447]:   </devices>
Jul 31 12:18:41 user nova-compute[72447]: </domain>
Jul 31 12:18:41 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1458018657',display_name='tempest-VolumesAdminNegativeTest-server-1458018657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1458018657',id=22,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6gGsgHf+u6je3fi5pWRspe4+1YTnpK5hZvO8sUwujpYUpFmmvlxOMD5JFWNVDMpu2iD/kmIgb11TZGP3796bpNESzn0aILceRSguMB3asFulMT8qlvL2kj+wmGJcWUhQ==',key_name='tempest-keypair-2024619754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3110024c6d94eff885a84c59a01a85c',ramdisk_id='',reservation_id='r-dg2dw1ts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-420445056',owner_user_name='tempest-VolumesAdminNegativeTest-420445056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ead2fe8321b41be8bfc78f2bd5a036b',uuid=b291ba57-9fdb-48f2-ac0c-45a108dda3b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "address": "fa:16:3e:59:1a:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd04ddb5-46", "ovs_interfaceid": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Converting VIF {"id": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "address": "fa:16:3e:59:1a:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd04ddb5-46", "ovs_interfaceid": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:1a:27,bridge_name='br-int',has_traffic_filtering=True,id=cd04ddb5-4657-4e58-b422-7431d46e9ab5,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd04ddb5-46') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG os_vif [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:1a:27,bridge_name='br-int',has_traffic_filtering=True,id=cd04ddb5-4657-4e58-b422-7431d46e9ab5,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd04ddb5-46') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd04ddb5-46, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd04ddb5-46, col_values=(('external_ids', {'iface-id': 'cd04ddb5-4657-4e58-b422-7431d46e9ab5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:1a:27', 'vm-uuid': 'b291ba57-9fdb-48f2-ac0c-45a108dda3b1'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:41 user nova-compute[72447]: INFO os_vif [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:1a:27,bridge_name='br-int',has_traffic_filtering=True,id=cd04ddb5-4657-4e58-b422-7431d46e9ab5,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd04ddb5-46')
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:18:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] No VIF found with MAC fa:16:3e:59:1a:27, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:18:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-825b0d32-960f-4f77-8934-3d8b62789ca5 req-dfe65734-1b51-4a59-bb1a-c9fd4fb195d4 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Received event network-changed-cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-825b0d32-960f-4f77-8934-3d8b62789ca5 req-dfe65734-1b51-4a59-bb1a-c9fd4fb195d4 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Refreshing instance network info cache due to event network-changed-cd04ddb5-4657-4e58-b422-7431d46e9ab5. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:18:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-825b0d32-960f-4f77-8934-3d8b62789ca5 req-dfe65734-1b51-4a59-bb1a-c9fd4fb195d4 service nova] Acquiring lock "refresh_cache-b291ba57-9fdb-48f2-ac0c-45a108dda3b1" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:18:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-825b0d32-960f-4f77-8934-3d8b62789ca5 req-dfe65734-1b51-4a59-bb1a-c9fd4fb195d4 service nova] Acquired lock "refresh_cache-b291ba57-9fdb-48f2-ac0c-45a108dda3b1" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:18:42 user nova-compute[72447]: DEBUG nova.network.neutron [req-825b0d32-960f-4f77-8934-3d8b62789ca5 req-dfe65734-1b51-4a59-bb1a-c9fd4fb195d4 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Refreshing network info cache for port cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:18:43 user nova-compute[72447]: DEBUG nova.network.neutron [req-825b0d32-960f-4f77-8934-3d8b62789ca5 req-dfe65734-1b51-4a59-bb1a-c9fd4fb195d4 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Updated VIF entry in instance network info cache for port cd04ddb5-4657-4e58-b422-7431d46e9ab5. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:18:43 user nova-compute[72447]: DEBUG nova.network.neutron [req-825b0d32-960f-4f77-8934-3d8b62789ca5 req-dfe65734-1b51-4a59-bb1a-c9fd4fb195d4 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Updating instance_info_cache with network_info: [{"id": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "address": "fa:16:3e:59:1a:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd04ddb5-46", "ovs_interfaceid": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-825b0d32-960f-4f77-8934-3d8b62789ca5 req-dfe65734-1b51-4a59-bb1a-c9fd4fb195d4 service nova] Releasing lock "refresh_cache-b291ba57-9fdb-48f2-ac0c-45a108dda3b1" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:18:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:44 user nova-compute[72447]: INFO nova.compute.manager [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Rebooting instance
Jul 31 12:18:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquired lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG nova.network.neutron [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-d85ca288-9dbe-4161-a5d9-32c62f2619e0 req-83f40762-7e9a-4cdf-bd8e-9800e9e5e3c7 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Received event network-vif-plugged-cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d85ca288-9dbe-4161-a5d9-32c62f2619e0 req-83f40762-7e9a-4cdf-bd8e-9800e9e5e3c7 service nova] Acquiring lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d85ca288-9dbe-4161-a5d9-32c62f2619e0 req-83f40762-7e9a-4cdf-bd8e-9800e9e5e3c7 service nova] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d85ca288-9dbe-4161-a5d9-32c62f2619e0 req-83f40762-7e9a-4cdf-bd8e-9800e9e5e3c7 service nova] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-d85ca288-9dbe-4161-a5d9-32c62f2619e0 req-83f40762-7e9a-4cdf-bd8e-9800e9e5e3c7 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] No waiting events found dispatching network-vif-plugged-cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:18:44 user nova-compute[72447]: WARNING nova.compute.manager [req-d85ca288-9dbe-4161-a5d9-32c62f2619e0 req-83f40762-7e9a-4cdf-bd8e-9800e9e5e3c7 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Received unexpected event network-vif-plugged-cd04ddb5-4657-4e58-b422-7431d46e9ab5 for instance with vm_state building and task_state spawning.
Jul 31 12:18:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-d85ca288-9dbe-4161-a5d9-32c62f2619e0 req-83f40762-7e9a-4cdf-bd8e-9800e9e5e3c7 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Received event network-vif-plugged-cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d85ca288-9dbe-4161-a5d9-32c62f2619e0 req-83f40762-7e9a-4cdf-bd8e-9800e9e5e3c7 service nova] Acquiring lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d85ca288-9dbe-4161-a5d9-32c62f2619e0 req-83f40762-7e9a-4cdf-bd8e-9800e9e5e3c7 service nova] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d85ca288-9dbe-4161-a5d9-32c62f2619e0 req-83f40762-7e9a-4cdf-bd8e-9800e9e5e3c7 service nova] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-d85ca288-9dbe-4161-a5d9-32c62f2619e0 req-83f40762-7e9a-4cdf-bd8e-9800e9e5e3c7 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] No waiting events found dispatching network-vif-plugged-cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:18:44 user nova-compute[72447]: WARNING nova.compute.manager [req-d85ca288-9dbe-4161-a5d9-32c62f2619e0 req-83f40762-7e9a-4cdf-bd8e-9800e9e5e3c7 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Received unexpected event network-vif-plugged-cd04ddb5-4657-4e58-b422-7431d46e9ab5 for instance with vm_state building and task_state spawning.
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.network.neutron [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updating instance_info_cache with network_info: [{"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Releasing lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805925.7503219, b291ba57-9fdb-48f2-ac0c-45a108dda3b1 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:18:45 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] VM Resumed (Lifecycle Event)
Jul 31 12:18:45 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Instance spawned successfully.
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:18:45 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805925.7514253, b291ba57-9fdb-48f2-ac0c-45a108dda3b1 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:18:45 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] VM Started (Lifecycle Event)
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:18:45 user nova-compute[72447]: INFO nova.compute.manager [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Took 7.31 seconds to spawn the instance on the hypervisor.
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:18:45 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:18:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "0dbd2353-0521-4e92-8722-6151bfb40924" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:18:45 user nova-compute[72447]: INFO nova.compute.manager [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Took 8.30 seconds to build instance.
Jul 31 12:18:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0b784a06-06e5-425c-832f-9383be29b344 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.401s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:18:46 user nova-compute[72447]: INFO nova.compute.claims [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Claim successful on node user
Jul 31 12:18:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Instance destroyed successfully.
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'resources' on Instance uuid e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1639847318',display_name='tempest-TestMinimumBasicScenario-server-1639847318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1639847318',id=18,image_ref='c50de5cc-8b81-4552-a892-a8a60da6e3ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByc5+TYn0U9H18DTmmjCJIFBIkeEbJS4pya3RhJF5gO675iLeoBkMf6n1Bo415YPpSYsW3OKsfLEylBcx7ws9w5x+4Xov1Sp4zSG+cejgKWA/ew9wHMEi+FSgcvY5Lggg==',key_name='tempest-TestMinimumBasicScenario-182857311',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:16:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c212a5254bcc4de290ec4bfbf8fbbd4b',ramdisk_id='',reservation_id='r-p5cjl6yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c50de5cc-8b81-4552-a892-a8a60da6e3ac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1422809681',owner_user_name='tempest-TestMinimumBasicScenario-1422809681-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:18:45Z,user_data=None,user_id='a40e5176e01443a085c01fc677cc8ca9',uuid=e75d2046-19d7-46b8-9c63-5af205c87c08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converting VIF {"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_vif [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc491e329-e2, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:46 user nova-compute[72447]: INFO os_vif [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2')
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkgrlMum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:18:46 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ca3599-9971-4128-92ae-a51080c93dca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc9e39c-d000-4d42-93b2-ead7fa56f460]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:18:46 user nova-compute[72447]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:18:46 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:18:46 user nova-compute[72447]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:18:46 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06682e6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f906c1-88e5-44ee-89bc-05e87d062d16]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6e92ad-f19a-4e28-9ac4-d894927e0134]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea93d38c-9c6c-4283-b289-6c564785d007]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.105s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2022e26-55b9-4ff1-baaf-40ab86e0efbc]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[29225ab8-cb71-4b7d-8a16-bbfc4551f216]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b8240f-468c-4908-8998-110be3a1d8ed]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260]
Jul 31 12:18:46 user nova-compute[72447]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260] successful.
Jul 31 12:18:46 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1195d4c4-8cc1-4480-8491-157e26acf38d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] <== disconnect_volume: return (362ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Start _get_guest_xml network_info=[{"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c50de5cc-8b81-4552-a892-a8a60da6e3ac,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'c50de5cc-8b81-4552-a892-a8a60da6e3ac'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'ea9d4fe5-6f12-433d-a044-e3e8ad11ef6d', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkgrlMum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e75d2046-19d7-46b8-9c63-5af205c87c08', 'attached_at': '', 'detached_at': '', 'volume_id': '9b7d15ea-d519-4598-a858-d87931572ea3', 'serial': '9b7d15ea-d519-4598-a858-d87931572ea3'}, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:18:46 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:18:46 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c50de5cc-8b81-4552-a892-a8a60da6e3ac,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'vcpu_model' on Instance uuid e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-27015c88-8f6e-418c-a3e3-07b032a1a187 req-fd9f4e73-f818-4691-a193-80600eec2944 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-vif-unplugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-27015c88-8f6e-418c-a3e3-07b032a1a187 req-fd9f4e73-f818-4691-a193-80600eec2944 service nova] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-27015c88-8f6e-418c-a3e3-07b032a1a187 req-fd9f4e73-f818-4691-a193-80600eec2944 service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-27015c88-8f6e-418c-a3e3-07b032a1a187 req-fd9f4e73-f818-4691-a193-80600eec2944 service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-27015c88-8f6e-418c-a3e3-07b032a1a187 req-fd9f4e73-f818-4691-a193-80600eec2944 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] No waiting events found dispatching network-vif-unplugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:18:46 user nova-compute[72447]: WARNING nova.compute.manager [req-27015c88-8f6e-418c-a3e3-07b032a1a187 req-fd9f4e73-f818-4691-a193-80600eec2944 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received unexpected event network-vif-unplugged-c491e329-e20e-47e6-893a-7643968aba7e for instance with vm_state active and task_state reboot_started_hard.
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-27015c88-8f6e-418c-a3e3-07b032a1a187 req-fd9f4e73-f818-4691-a193-80600eec2944 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-27015c88-8f6e-418c-a3e3-07b032a1a187 req-fd9f4e73-f818-4691-a193-80600eec2944 service nova] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-27015c88-8f6e-418c-a3e3-07b032a1a187 req-fd9f4e73-f818-4691-a193-80600eec2944 service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-27015c88-8f6e-418c-a3e3-07b032a1a187 req-fd9f4e73-f818-4691-a193-80600eec2944 service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-27015c88-8f6e-418c-a3e3-07b032a1a187 req-fd9f4e73-f818-4691-a193-80600eec2944 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] No waiting events found dispatching network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:18:46 user nova-compute[72447]: WARNING nova.compute.manager [req-27015c88-8f6e-418c-a3e3-07b032a1a187 req-fd9f4e73-f818-4691-a193-80600eec2944 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received unexpected event network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e for instance with vm_state active and task_state reboot_started_hard.
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkgrlMum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:18:46 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:18:46 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:18:46 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7daed07-5398-4ba3-83da-19e4dc9c74de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:18:46 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[789ef023-1843-4345-b009-c877e8e35143]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3] added
Jul 31 12:18:46 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa07f6a-7d08-42f2-b02e-6bd4e6466f81]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0315ec51-c35c-44e4-9eab-a6488a05037f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RkgrlMum {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RkgrlMum" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d51e2af-f5ea-4379-a0ba-2d10ad9a004f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RkgrlMum'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b12124e-eef1-48b5-9270-51e018783e65]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: INFO nova.virt.block_device [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Booting with blank volume at /dev/vda
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0b767a-557e-4d40-8c81-a5207f0f3a72]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:18:46 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:18:46 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG nova.policy [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33268392189342ecbca53c9ad959245e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a055fae579aa4858867824625e8bd18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72342e0-65c4-47f1-8654-30f8d0f0dd97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260]
Jul 31 12:18:46 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260] successful.
Jul 31 12:18:46 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06e695f-7de1-472c-bda1-b8e598ca4a25]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4171abfd-5690-4866-a88b-d4232b16b3e1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:18:46 user nova-compute[72447]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:18:46 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:18:46 user nova-compute[72447]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:18:46 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[980bd7f7-8017-4484-b353-50f39e8b37ad]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:18:47 user nova-compute[72447]: DEBUG nova.network.neutron [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Successfully created port: 7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:18:47 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:18:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkgrlMum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:18:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:18:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26637643035623132', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:18:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637643035623132', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1639847318',display_name='tempest-TestMinimumBasicScenario-server-1639847318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1639847318',id=18,image_ref='c50de5cc-8b81-4552-a892-a8a60da6e3ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByc5+TYn0U9H18DTmmjCJIFBIkeEbJS4pya3RhJF5gO675iLeoBkMf6n1Bo415YPpSYsW3OKsfLEylBcx7ws9w5x+4Xov1Sp4zSG+cejgKWA/ew9wHMEi+FSgcvY5Lggg==',key_name='tempest-TestMinimumBasicScenario-182857311',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:16:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c212a5254bcc4de290ec4bfbf8fbbd4b',ramdisk_id='',reservation_id='r-p5cjl6yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c50de5cc-8b81-4552-a892-a8a60da6e3ac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1422809681',owner_user_name='tempest-TestMinimumBasicScenario-1422809681-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:18:45Z,user_data=None,user_id='a40e5176e01443a085c01fc677cc8ca9',uuid=e75d2046-19d7-46b8-9c63-5af205c87c08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converting VIF {"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'pci_devices' on Instance uuid e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:18:48 user nova-compute[72447]:   <uuid>e75d2046-19d7-46b8-9c63-5af205c87c08</uuid>
Jul 31 12:18:48 user nova-compute[72447]:   <name>instance-00000012</name>
Jul 31 12:18:48 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:18:48 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:18:48 user nova-compute[72447]:   <metadata>
Jul 31 12:18:48 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:18:48 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:18:48 user nova-compute[72447]:       <nova:name>tempest-TestMinimumBasicScenario-server-1639847318</nova:name>
Jul 31 12:18:48 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:18:46</nova:creationTime>
Jul 31 12:18:48 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:18:48 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:18:48 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:18:48 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:18:48 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:18:48 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:18:48 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:18:48 user nova-compute[72447]:       <nova:owner>
Jul 31 12:18:48 user nova-compute[72447]:         <nova:user uuid="a40e5176e01443a085c01fc677cc8ca9">tempest-TestMinimumBasicScenario-1422809681-project-member</nova:user>
Jul 31 12:18:48 user nova-compute[72447]:         <nova:project uuid="c212a5254bcc4de290ec4bfbf8fbbd4b">tempest-TestMinimumBasicScenario-1422809681</nova:project>
Jul 31 12:18:48 user nova-compute[72447]:       </nova:owner>
Jul 31 12:18:48 user nova-compute[72447]:       <nova:root type="image" uuid="c50de5cc-8b81-4552-a892-a8a60da6e3ac"/>
Jul 31 12:18:48 user nova-compute[72447]:       <nova:ports>
Jul 31 12:18:48 user nova-compute[72447]:         <nova:port uuid="c491e329-e20e-47e6-893a-7643968aba7e">
Jul 31 12:18:48 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 12:18:48 user nova-compute[72447]:         </nova:port>
Jul 31 12:18:48 user nova-compute[72447]:       </nova:ports>
Jul 31 12:18:48 user nova-compute[72447]:     </nova:instance>
Jul 31 12:18:48 user nova-compute[72447]:   </metadata>
Jul 31 12:18:48 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:18:48 user nova-compute[72447]:     <system>
Jul 31 12:18:48 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:18:48 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:18:48 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:18:48 user nova-compute[72447]:       <entry name="serial">e75d2046-19d7-46b8-9c63-5af205c87c08</entry>
Jul 31 12:18:48 user nova-compute[72447]:       <entry name="uuid">e75d2046-19d7-46b8-9c63-5af205c87c08</entry>
Jul 31 12:18:48 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:18:48 user nova-compute[72447]:     </system>
Jul 31 12:18:48 user nova-compute[72447]:   </sysinfo>
Jul 31 12:18:48 user nova-compute[72447]:   <os>
Jul 31 12:18:48 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:18:48 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:18:48 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:18:48 user nova-compute[72447]:   </os>
Jul 31 12:18:48 user nova-compute[72447]:   <features>
Jul 31 12:18:48 user nova-compute[72447]:     <acpi/>
Jul 31 12:18:48 user nova-compute[72447]:     <apic/>
Jul 31 12:18:48 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:18:48 user nova-compute[72447]:   </features>
Jul 31 12:18:48 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:18:48 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:18:48 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:18:48 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:18:48 user nova-compute[72447]:   </clock>
Jul 31 12:18:48 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:18:48 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:18:48 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:18:48 user nova-compute[72447]:   </cpu>
Jul 31 12:18:48 user nova-compute[72447]:   <devices>
Jul 31 12:18:48 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:18:48 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:18:48 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk"/>
Jul 31 12:18:48 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:18:48 user nova-compute[72447]:     </disk>
Jul 31 12:18:48 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:18:48 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:18:48 user nova-compute[72447]:       <source dev="/dev/sdb"/>
Jul 31 12:18:48 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:18:48 user nova-compute[72447]:       <serial>9b7d15ea-d519-4598-a858-d87931572ea3</serial>
Jul 31 12:18:48 user nova-compute[72447]:     </disk>
Jul 31 12:18:48 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:18:48 user nova-compute[72447]:       <mac address="fa:16:3e:9a:97:2f"/>
Jul 31 12:18:48 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:18:48 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:18:48 user nova-compute[72447]:       <target dev="tapc491e329-e2"/>
Jul 31 12:18:48 user nova-compute[72447]:     </interface>
Jul 31 12:18:48 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:18:48 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/console.log" append="off"/>
Jul 31 12:18:48 user nova-compute[72447]:     </serial>
Jul 31 12:18:48 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:18:48 user nova-compute[72447]:     <video>
Jul 31 12:18:48 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:18:48 user nova-compute[72447]:     </video>
Jul 31 12:18:48 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:18:48 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:18:48 user nova-compute[72447]:     </rng>
Jul 31 12:18:48 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:18:48 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:18:48 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:18:48 user nova-compute[72447]:     </memballoon>
Jul 31 12:18:48 user nova-compute[72447]:   </devices>
Jul 31 12:18:48 user nova-compute[72447]: </domain>
Jul 31 12:18:48 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'trusted_certs' on Instance uuid e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632 --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632 --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-2f98bc8b-537a-4b34-85ce-d7baac240046" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-2f98bc8b-537a-4b34-85ce-d7baac240046" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Successfully updated port: 7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquired lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-f49b429e-c6e4-477f-a2c0-286dd386d6f3 req-e08e0aa1-8448-42a9-89f1-0bf5331aaab4 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-changed-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-f49b429e-c6e4-477f-a2c0-286dd386d6f3 req-e08e0aa1-8448-42a9-89f1-0bf5331aaab4 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Refreshing instance network info cache due to event network-changed-7e1213ee-4076-42af-a8cb-d3825739d314. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f49b429e-c6e4-477f-a2c0-286dd386d6f3 req-e08e0aa1-8448-42a9-89f1-0bf5331aaab4 service nova] Acquiring lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Cannot resize image /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'migration_context' on Instance uuid e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1639847318',display_name='tempest-TestMinimumBasicScenario-server-1639847318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1639847318',id=18,image_ref='c50de5cc-8b81-4552-a892-a8a60da6e3ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByc5+TYn0U9H18DTmmjCJIFBIkeEbJS4pya3RhJF5gO675iLeoBkMf6n1Bo415YPpSYsW3OKsfLEylBcx7ws9w5x+4Xov1Sp4zSG+cejgKWA/ew9wHMEi+FSgcvY5Lggg==',key_name='tempest-TestMinimumBasicScenario-182857311',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:16:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='c212a5254bcc4de290ec4bfbf8fbbd4b',ramdisk_id='',reservation_id='r-p5cjl6yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c50de5cc-8b81-4552-a892-a8a60da6e3ac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1422809681',owner_user_name='tempest-TestMinimumBasicScenario-1422809681-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:18:45Z,user_data=None,user_id='a40e5176e01443a085c01fc677cc8ca9',uuid=e75d2046-19d7-46b8-9c63-5af205c87c08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converting VIF {"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG os_vif [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc491e329-e2, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc491e329-e2, col_values=(('external_ids', {'iface-id': 'c491e329-e20e-47e6-893a-7643968aba7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:97:2f', 'vm-uuid': 'e75d2046-19d7-46b8-9c63-5af205c87c08'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:18:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:48 user nova-compute[72447]: INFO os_vif [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2')
Jul 31 12:18:49 user nova-compute[72447]: DEBUG nova.network.neutron [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Updating instance_info_cache with network_info: [{"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Releasing lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:18:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Instance network_info: |[{"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:18:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f49b429e-c6e4-477f-a2c0-286dd386d6f3 req-e08e0aa1-8448-42a9-89f1-0bf5331aaab4 service nova] Acquired lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:18:49 user nova-compute[72447]: DEBUG nova.network.neutron [req-f49b429e-c6e4-477f-a2c0-286dd386d6f3 req-e08e0aa1-8448-42a9-89f1-0bf5331aaab4 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Refreshing network info cache for port 7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:18:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:49 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Updating instance_info_cache with network_info: [{"id": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "address": "fa:16:3e:41:f6:dd", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba08be19-41", "ovs_interfaceid": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-2f98bc8b-537a-4b34-85ce-d7baac240046" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:18:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:18:49 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:18:49 user nova-compute[72447]: DEBUG nova.network.neutron [req-f49b429e-c6e4-477f-a2c0-286dd386d6f3 req-e08e0aa1-8448-42a9-89f1-0bf5331aaab4 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Updated VIF entry in instance network info cache for port 7e1213ee-4076-42af-a8cb-d3825739d314. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:18:49 user nova-compute[72447]: DEBUG nova.network.neutron [req-f49b429e-c6e4-477f-a2c0-286dd386d6f3 req-e08e0aa1-8448-42a9-89f1-0bf5331aaab4 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Updating instance_info_cache with network_info: [{"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f49b429e-c6e4-477f-a2c0-286dd386d6f3 req-e08e0aa1-8448-42a9-89f1-0bf5331aaab4 service nova] Releasing lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:18:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-7b790c03-adba-4b25-a0e4-8298134aeec5 req-2cfa933a-2c91-4ff3-b618-4c99a7d971a6 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7b790c03-adba-4b25-a0e4-8298134aeec5 req-2cfa933a-2c91-4ff3-b618-4c99a7d971a6 service nova] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7b790c03-adba-4b25-a0e4-8298134aeec5 req-2cfa933a-2c91-4ff3-b618-4c99a7d971a6 service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7b790c03-adba-4b25-a0e4-8298134aeec5 req-2cfa933a-2c91-4ff3-b618-4c99a7d971a6 service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-7b790c03-adba-4b25-a0e4-8298134aeec5 req-2cfa933a-2c91-4ff3-b618-4c99a7d971a6 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] No waiting events found dispatching network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:18:50 user nova-compute[72447]: WARNING nova.compute.manager [req-7b790c03-adba-4b25-a0e4-8298134aeec5 req-2cfa933a-2c91-4ff3-b618-4c99a7d971a6 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received unexpected event network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e for instance with vm_state active and task_state reboot_started_hard.
Jul 31 12:18:51 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for e75d2046-19d7-46b8-9c63-5af205c87c08 due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805932.34711, e75d2046-19d7-46b8-9c63-5af205c87c08 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:18:52 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] VM Resumed (Lifecycle Event)
Jul 31 12:18:52 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Instance rebooted successfully.
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-d088aba7-f4ff-432a-92c5-e233c07dd1ef req-be5b8f46-b3c5-43c2-a7ce-8a91539cb9cc service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event network-changed-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-d088aba7-f4ff-432a-92c5-e233c07dd1ef req-be5b8f46-b3c5-43c2-a7ce-8a91539cb9cc service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Refreshing instance network info cache due to event network-changed-2b84f682-ff0f-447b-ab90-bc71768a0b31. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d088aba7-f4ff-432a-92c5-e233c07dd1ef req-be5b8f46-b3c5-43c2-a7ce-8a91539cb9cc service nova] Acquiring lock "refresh_cache-c3a723a9-2a7f-46b9-a326-501d77ad7c16" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d088aba7-f4ff-432a-92c5-e233c07dd1ef req-be5b8f46-b3c5-43c2-a7ce-8a91539cb9cc service nova] Acquired lock "refresh_cache-c3a723a9-2a7f-46b9-a326-501d77ad7c16" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.network.neutron [req-d088aba7-f4ff-432a-92c5-e233c07dd1ef req-be5b8f46-b3c5-43c2-a7ce-8a91539cb9cc service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Refreshing network info cache for port 2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:18:52 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805932.3473372, e75d2046-19d7-46b8-9c63-5af205c87c08 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:18:52 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] VM Started (Lifecycle Event)
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-04714fe3-ca8a-42a9-880a-28b2a80a193f tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.972s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG os_brick.utils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a076f332-dfc2-4cbc-921d-5e612afbfa75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacf1f25-6765-4b11-b24c-03805502d452]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c084e23-e953-4c3f-a9ab-255d8ffd5ac6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[14530ad1-820b-4b2e-9557-e3c908e54e2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:18:52 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[da82fd8c-550d-4764-8aa5-5a64dfbc974c]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG os_brick.utils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Updating existing volume attachment record: 9a371cb6-0589-4224-b6f3-7cc7a8ebaeb4 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-0cc1c1e4-3791-44e1-8449-0206b1f33d6f req-8b695792-e29b-4047-a6a3-7c6303d7372b service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0cc1c1e4-3791-44e1-8449-0206b1f33d6f req-8b695792-e29b-4047-a6a3-7c6303d7372b service nova] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0cc1c1e4-3791-44e1-8449-0206b1f33d6f req-8b695792-e29b-4047-a6a3-7c6303d7372b service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0cc1c1e4-3791-44e1-8449-0206b1f33d6f req-8b695792-e29b-4047-a6a3-7c6303d7372b service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-0cc1c1e4-3791-44e1-8449-0206b1f33d6f req-8b695792-e29b-4047-a6a3-7c6303d7372b service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] No waiting events found dispatching network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:18:52 user nova-compute[72447]: WARNING nova.compute.manager [req-0cc1c1e4-3791-44e1-8449-0206b1f33d6f req-8b695792-e29b-4047-a6a3-7c6303d7372b service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received unexpected event network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e for instance with vm_state active and task_state None.
Jul 31 12:18:53 user nova-compute[72447]: DEBUG nova.network.neutron [req-d088aba7-f4ff-432a-92c5-e233c07dd1ef req-be5b8f46-b3c5-43c2-a7ce-8a91539cb9cc service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Updated VIF entry in instance network info cache for port 2b84f682-ff0f-447b-ab90-bc71768a0b31. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:18:53 user nova-compute[72447]: DEBUG nova.network.neutron [req-d088aba7-f4ff-432a-92c5-e233c07dd1ef req-be5b8f46-b3c5-43c2-a7ce-8a91539cb9cc service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Updating instance_info_cache with network_info: [{"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:18:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d088aba7-f4ff-432a-92c5-e233c07dd1ef req-be5b8f46-b3c5-43c2-a7ce-8a91539cb9cc service nova] Releasing lock "refresh_cache-c3a723a9-2a7f-46b9-a326-501d77ad7c16" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:18:53 user nova-compute[72447]: INFO nova.compute.manager [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Rebuilding instance
Jul 31 12:18:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lazy-loading 'trusted_certs' on Instance uuid c3a723a9-2a7f-46b9-a326-501d77ad7c16 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:18:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lazy-loading 'pci_requests' on Instance uuid c3a723a9-2a7f-46b9-a326-501d77ad7c16 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lazy-loading 'pci_devices' on Instance uuid c3a723a9-2a7f-46b9-a326-501d77ad7c16 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lazy-loading 'resources' on Instance uuid c3a723a9-2a7f-46b9-a326-501d77ad7c16 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lazy-loading 'migration_context' on Instance uuid c3a723a9-2a7f-46b9-a326-501d77ad7c16 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:18:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72447) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 12:18:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-e2363365-d082-4600-b56d-bc198deb3dbd req-99838eef-efa4-4bb6-b843-463f00b138a5 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event network-vif-unplugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e2363365-d082-4600-b56d-bc198deb3dbd req-99838eef-efa4-4bb6-b843-463f00b138a5 service nova] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e2363365-d082-4600-b56d-bc198deb3dbd req-99838eef-efa4-4bb6-b843-463f00b138a5 service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e2363365-d082-4600-b56d-bc198deb3dbd req-99838eef-efa4-4bb6-b843-463f00b138a5 service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-e2363365-d082-4600-b56d-bc198deb3dbd req-99838eef-efa4-4bb6-b843-463f00b138a5 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] No waiting events found dispatching network-vif-unplugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:18:54 user nova-compute[72447]: WARNING nova.compute.manager [req-e2363365-d082-4600-b56d-bc198deb3dbd req-99838eef-efa4-4bb6-b843-463f00b138a5 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received unexpected event network-vif-unplugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 for instance with vm_state active and task_state rebuilding.
Jul 31 12:18:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:54 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Instance destroyed successfully.
Jul 31 12:18:54 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Instance destroyed successfully.
Jul 31 12:18:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1499780947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1455078153',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECGXIy4PDnzg6ek+j2HG9HwhyLJVMPlacwsNKl7bNxDhJp0QusrhfASjEy/UNcWcKH7CNfC2QWxQjStvqwQeEecRmaAyf/xqGPScqaT5/FIjyOOce+GAHOyAskfUB7sFg==',key_name='tempest-keypair-1780767399',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:17:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5fefc91464b24c68a6d7f9059ec58b5f',ramdisk_id='',reservation_id='r-fif9fh4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1359270950',owner_user_name='tempest-ServerActionsV293TestJSON-1359270950-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855a22b65634f1690901a5f9be8e885',uuid=c3a723a9-2a7f-46b9-a326-501d77ad7c16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converting VIF {"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG os_vif [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b84f682-ff, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:18:54 user nova-compute[72447]: INFO os_vif [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff')
Jul 31 12:18:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCOzraS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:18:54 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 12:18:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.008s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fe142b-272e-436a-b252-a2e3b69e91f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf3e4b5-4374-4507-9da5-a7375051af07]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:18:54 user nova-compute[72447]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:18:54 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:18:54 user nova-compute[72447]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:18:54 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06682e6c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb'): ({'sdc'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Removing single pathed devices sdc {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f59107f-7dcb-472b-aa6f-28356a1cc4f8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[422a8753-aee2-410e-b4c1-3da3d6862d78]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Flushing IO for device /dev/sdc {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dd6f59-5fe3-4f45-9512-5d4f27ba5941]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:54 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.067s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef3476-2f2d-4c8d-85a1-deb3912c9b03]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd7e3fe84-515b181c09000dd1', '/dev/disk/by-id/scsi-23531356231383163', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d7e3fe84') {{(pid=83492) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[65960aaf-0b59-4ece-a2b1-b6974352c69e]: (4, None) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c48e142-1b45-478a-a807-4534288d29d4]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1e9816-9763-4047-957c-38c8c0972e3a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260]
Jul 31 12:18:55 user nova-compute[72447]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260] successful.
Jul 31 12:18:55 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa05c15-3e45-4b38-b7d4-b083f4f3cd2d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] <== disconnect_volume: return (418ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:18:55 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Deleting instance files /opt/stack/data/nova/instances/c3a723a9-2a7f-46b9-a326-501d77ad7c16_del
Jul 31 12:18:55 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Deletion of /opt/stack/data/nova/instances/c3a723a9-2a7f-46b9-a326-501d77ad7c16_del complete
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:55 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance c3a723a9-2a7f-46b9-a326-501d77ad7c16 could not be found.
Jul 31 12:18:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCOzraS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:18:55 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73ebb99-76f4-407c-8024-56e0776dd2dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ddd67f-417c-4ce5-a2e2-3a9747be3f34]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:18:55 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:18:55 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0668505ab0>, {}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Disconnecting from: [] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] <== disconnect_volume: return (77ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-5daaaa68-0cec-42fd-b91b-74a997d599b4 req-8c471f31-7ed3-491b-82b5-7b9a1d166296 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5daaaa68-0cec-42fd-b91b-74a997d599b4 req-8c471f31-7ed3-491b-82b5-7b9a1d166296 service nova] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5daaaa68-0cec-42fd-b91b-74a997d599b4 req-8c471f31-7ed3-491b-82b5-7b9a1d166296 service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5daaaa68-0cec-42fd-b91b-74a997d599b4 req-8c471f31-7ed3-491b-82b5-7b9a1d166296 service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-5daaaa68-0cec-42fd-b91b-74a997d599b4 req-8c471f31-7ed3-491b-82b5-7b9a1d166296 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] No waiting events found dispatching network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:18:56 user nova-compute[72447]: WARNING nova.compute.manager [req-5daaaa68-0cec-42fd-b91b-74a997d599b4 req-8c471f31-7ed3-491b-82b5-7b9a1d166296 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received unexpected event network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 for instance with vm_state active and task_state rebuilding.
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:18:59 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Error from libvirt while getting description of instance-00000013: [Error Code 42] Domain not found: no domain with matching uuid 'c3a723a9-2a7f-46b9-a326-501d77ad7c16' (instance-00000013): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c3a723a9-2a7f-46b9-a326-501d77ad7c16' (instance-00000013)
Jul 31 12:18:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:59 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:18:59 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7252MB free_disk=25.311046600341797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2f98bc8b-537a-4b34-85ce-d7baac240046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 92ff498b-1337-47da-aaf1-b5fb9f19e98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance e75d2046-19d7-46b8-9c63-5af205c87c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance c3a723a9-2a7f-46b9-a326-501d77ad7c16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 08c02c81-b860-45e8-a4e0-126b2151c601 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 87220d5b-df7b-4664-a5e8-088157130701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b291ba57-9fdb-48f2-ac0c-45a108dda3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:18:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:19:00 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:19:00 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:19:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:19:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:01 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:19:01 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:19:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Preparing to wait for external event volume-reimaged-f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb {{(pid=72447) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 31 12:19:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.compute.manager [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:19:02 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Creating image(s)
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Ensure instance console log exists: /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Start _get_guest_xml network_info=[{"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '9a371cb6-0589-4224-b6f3-7cc7a8ebaeb4', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbGehHtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0dbd2353-0521-4e92-8722-6151bfb40924', 'attached_at': '', 'detached_at': '', 'volume_id': '5c390fca-f26f-4a6f-8340-a3037945e466', 'serial': '5c390fca-f26f-4a6f-8340-a3037945e466'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:19:02 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:19:02 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbGehHtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:19:02 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:19:02 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:19:02 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07a2777-f67d-44b7-9617-c2ef1ac6d280]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:19:02 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b1690b-6f64-432b-89c2-f2677ae29fc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466] added
Jul 31 12:19:02 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[716910c0-fa07-43e8-82e8-9a0b27fbccc3]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[578d2aff-4cff-43ca-a36f-3d12c143700f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbGehHtk {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbGehHtk" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c8b272-43bf-4f59-889b-7940fe23ca3e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AbGehHtk'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f42a87-2b25-4854-8dad-9eea8ed97954]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46a13b7-5f79-44bf-a311-1035282e4f29]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:02 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:02 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8276424a-6cb4-4272-8da9-43db6d8b2329]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466, portal: 172.16.0.220,3260]
Jul 31 12:19:02 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466, portal: 172.16.0.220,3260] successful.
Jul 31 12:19:02 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[847868c3-4b84-4c7f-87ca-62864d223245]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6753cbb7-7b37-414c-9921-04c18a22591b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:02 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:19:02 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:02 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:19:02 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4221a0f-649a-44bc-8241-855f376af89a]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:19:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbGehHtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23965613463396265', 'path': '/dev/sdc'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965613463396265', 'path': '/dev/sdc'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-444683405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-444683405',id=23,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-io8hutry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:18:47Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=0dbd2353-0521-4e92-8722-6151bfb40924,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:a7:b9,bridge_name='br-int',has_traffic_filtering=True,id=7e1213ee-4076-42af-a8cb-d3825739d314,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1213ee-40') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dbd2353-0521-4e92-8722-6151bfb40924 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:19:03 user nova-compute[72447]:   <uuid>0dbd2353-0521-4e92-8722-6151bfb40924</uuid>
Jul 31 12:19:03 user nova-compute[72447]:   <name>instance-00000017</name>
Jul 31 12:19:03 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:19:03 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:19:03 user nova-compute[72447]:   <metadata>
Jul 31 12:19:03 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:19:03 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:19:03 user nova-compute[72447]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-444683405</nova:name>
Jul 31 12:19:03 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:19:02</nova:creationTime>
Jul 31 12:19:03 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:19:03 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:19:03 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:19:03 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:19:03 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:19:03 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:19:03 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:19:03 user nova-compute[72447]:       <nova:owner>
Jul 31 12:19:03 user nova-compute[72447]:         <nova:user uuid="33268392189342ecbca53c9ad959245e">tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member</nova:user>
Jul 31 12:19:03 user nova-compute[72447]:         <nova:project uuid="a055fae579aa4858867824625e8bd18d">tempest-ServerBootFromVolumeStableRescueTest-1637857313</nova:project>
Jul 31 12:19:03 user nova-compute[72447]:       </nova:owner>
Jul 31 12:19:03 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:19:03 user nova-compute[72447]:       <nova:ports>
Jul 31 12:19:03 user nova-compute[72447]:         <nova:port uuid="7e1213ee-4076-42af-a8cb-d3825739d314">
Jul 31 12:19:03 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 12:19:03 user nova-compute[72447]:         </nova:port>
Jul 31 12:19:03 user nova-compute[72447]:       </nova:ports>
Jul 31 12:19:03 user nova-compute[72447]:     </nova:instance>
Jul 31 12:19:03 user nova-compute[72447]:   </metadata>
Jul 31 12:19:03 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:19:03 user nova-compute[72447]:     <system>
Jul 31 12:19:03 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:19:03 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:19:03 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:19:03 user nova-compute[72447]:       <entry name="serial">0dbd2353-0521-4e92-8722-6151bfb40924</entry>
Jul 31 12:19:03 user nova-compute[72447]:       <entry name="uuid">0dbd2353-0521-4e92-8722-6151bfb40924</entry>
Jul 31 12:19:03 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:19:03 user nova-compute[72447]:     </system>
Jul 31 12:19:03 user nova-compute[72447]:   </sysinfo>
Jul 31 12:19:03 user nova-compute[72447]:   <os>
Jul 31 12:19:03 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:19:03 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:19:03 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:19:03 user nova-compute[72447]:   </os>
Jul 31 12:19:03 user nova-compute[72447]:   <features>
Jul 31 12:19:03 user nova-compute[72447]:     <acpi/>
Jul 31 12:19:03 user nova-compute[72447]:     <apic/>
Jul 31 12:19:03 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:19:03 user nova-compute[72447]:   </features>
Jul 31 12:19:03 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:19:03 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:19:03 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:19:03 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:19:03 user nova-compute[72447]:   </clock>
Jul 31 12:19:03 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:19:03 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:19:03 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:19:03 user nova-compute[72447]:   </cpu>
Jul 31 12:19:03 user nova-compute[72447]:   <devices>
Jul 31 12:19:03 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:19:03 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:19:03 user nova-compute[72447]:       <source dev="/dev/sdc"/>
Jul 31 12:19:03 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:19:03 user nova-compute[72447]:       <serial>5c390fca-f26f-4a6f-8340-a3037945e466</serial>
Jul 31 12:19:03 user nova-compute[72447]:     </disk>
Jul 31 12:19:03 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:19:03 user nova-compute[72447]:       <mac address="fa:16:3e:81:a7:b9"/>
Jul 31 12:19:03 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:19:03 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:19:03 user nova-compute[72447]:       <target dev="tap7e1213ee-40"/>
Jul 31 12:19:03 user nova-compute[72447]:     </interface>
Jul 31 12:19:03 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:19:03 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/console.log" append="off"/>
Jul 31 12:19:03 user nova-compute[72447]:     </serial>
Jul 31 12:19:03 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:19:03 user nova-compute[72447]:     <video>
Jul 31 12:19:03 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:19:03 user nova-compute[72447]:     </video>
Jul 31 12:19:03 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:19:03 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:19:03 user nova-compute[72447]:     </rng>
Jul 31 12:19:03 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:19:03 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:19:03 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:19:03 user nova-compute[72447]:     </memballoon>
Jul 31 12:19:03 user nova-compute[72447]:   </devices>
Jul 31 12:19:03 user nova-compute[72447]: </domain>
Jul 31 12:19:03 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-444683405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-444683405',id=23,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-io8hutry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:18:47Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=0dbd2353-0521-4e92-8722-6151bfb40924,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:a7:b9,bridge_name='br-int',has_traffic_filtering=True,id=7e1213ee-4076-42af-a8cb-d3825739d314,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1213ee-40') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG os_vif [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a7:b9,bridge_name='br-int',has_traffic_filtering=True,id=7e1213ee-4076-42af-a8cb-d3825739d314,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1213ee-40') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e1213ee-40, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e1213ee-40, col_values=(('external_ids', {'iface-id': '7e1213ee-4076-42af-a8cb-d3825739d314', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:a7:b9', 'vm-uuid': '0dbd2353-0521-4e92-8722-6151bfb40924'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:03 user nova-compute[72447]: INFO os_vif [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a7:b9,bridge_name='br-int',has_traffic_filtering=True,id=7e1213ee-4076-42af-a8cb-d3825739d314,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1213ee-40')
Jul 31 12:19:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:19:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No VIF found with MAC fa:16:3e:81:a7:b9, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:19:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-96b7db1e-378f-48ec-9eb1-8d29a5998221 req-d0379dc4-e639-4ea9-825a-cb2d83a126cc service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:19:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-96b7db1e-378f-48ec-9eb1-8d29a5998221 req-d0379dc4-e639-4ea9-825a-cb2d83a126cc service nova] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-96b7db1e-378f-48ec-9eb1-8d29a5998221 req-d0379dc4-e639-4ea9-825a-cb2d83a126cc service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-96b7db1e-378f-48ec-9eb1-8d29a5998221 req-d0379dc4-e639-4ea9-825a-cb2d83a126cc service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-96b7db1e-378f-48ec-9eb1-8d29a5998221 req-d0379dc4-e639-4ea9-825a-cb2d83a126cc service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] No waiting events found dispatching network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:19:05 user nova-compute[72447]: WARNING nova.compute.manager [req-96b7db1e-378f-48ec-9eb1-8d29a5998221 req-d0379dc4-e639-4ea9-825a-cb2d83a126cc service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received unexpected event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 for instance with vm_state building and task_state spawning.
Jul 31 12:19:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805947.124009, 0dbd2353-0521-4e92-8722-6151bfb40924 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:19:07 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] VM Resumed (Lifecycle Event)
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:19:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Instance spawned successfully.
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:07 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805947.1253123, 0dbd2353-0521-4e92-8722-6151bfb40924 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:19:07 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] VM Started (Lifecycle Event)
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-700238d9-9da1-4b28-b451-6a3013e3ab5d req-4240ec7f-272f-4d9d-bcc6-e7f65c7b1106 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-700238d9-9da1-4b28-b451-6a3013e3ab5d req-4240ec7f-272f-4d9d-bcc6-e7f65c7b1106 service nova] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-700238d9-9da1-4b28-b451-6a3013e3ab5d req-4240ec7f-272f-4d9d-bcc6-e7f65c7b1106 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-700238d9-9da1-4b28-b451-6a3013e3ab5d req-4240ec7f-272f-4d9d-bcc6-e7f65c7b1106 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-700238d9-9da1-4b28-b451-6a3013e3ab5d req-4240ec7f-272f-4d9d-bcc6-e7f65c7b1106 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] No waiting events found dispatching network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:19:07 user nova-compute[72447]: WARNING nova.compute.manager [req-700238d9-9da1-4b28-b451-6a3013e3ab5d req-4240ec7f-272f-4d9d-bcc6-e7f65c7b1106 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received unexpected event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 for instance with vm_state building and task_state spawning.
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:19:07 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:19:07 user nova-compute[72447]: INFO nova.compute.manager [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Took 5.17 seconds to spawn the instance on the hypervisor.
Jul 31 12:19:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:07 user nova-compute[72447]: INFO nova.compute.manager [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Took 21.34 seconds to build instance.
Jul 31 12:19:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-194c7470-1d34-4317-a46e-f87a02f5b56f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "0dbd2353-0521-4e92-8722-6151bfb40924" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.455s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:09 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690805934.7424486, c3a723a9-2a7f-46b9-a326-501d77ad7c16 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:19:09 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] VM Stopped (Lifecycle Event)
Jul 31 12:19:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-87260ff2-7776-4d50-adf3-fafd4e39d761 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 req-e52d8bc7-002a-4efb-9e1b-5b06f95d610f service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event volume-reimaged-f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 req-e52d8bc7-002a-4efb-9e1b-5b06f95d610f service nova] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 req-e52d8bc7-002a-4efb-9e1b-5b06f95d610f service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 req-e52d8bc7-002a-4efb-9e1b-5b06f95d610f service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 req-e52d8bc7-002a-4efb-9e1b-5b06f95d610f service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Processing event volume-reimaged-f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Instance event wait completed in 15 seconds for volume-reimaged {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:19:17 user nova-compute[72447]: INFO nova.virt.block_device [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Booting with volume f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb at /dev/vda
Jul 31 12:19:17 user nova-compute[72447]: DEBUG os_brick.utils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[add9fe13-4418-4dd2-91e3-a32d504beeca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d98dc76-e24a-40b6-9cab-bcd651a6a32c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ff87a8-9729-4184-9bc8-19f2b9318f8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5073ac-c10a-40cc-b502-07e08e0afac5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:19:17 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:19:17 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce70fc17-51d7-4c3c-bc31-9d258c95e7de]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG os_brick.utils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:19:17 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Updating existing volume attachment record: 9cf2912b-9e34-413d-9909-1c5d49cbe151 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:19:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "b5fe9835-8278-449e-9069-18421cb088dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "b5fe9835-8278-449e-9069-18421cb088dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:23 user nova-compute[72447]: DEBUG nova.compute.manager [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:19:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:19:23 user nova-compute[72447]: INFO nova.compute.claims [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Claim successful on node user
Jul 31 12:19:24 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG nova.network.neutron [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:19:24 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:19:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG nova.policy [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2c57df148eb4814a0b12ca7a6d9eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94646a9f184c43d4abbd4fac64c84344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:19:24 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Creating image(s)
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "/opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "/opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk 1073741824" returned: 0 in 0.052s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.130s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:24 user nova-compute[72447]: DEBUG nova.network.neutron [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Successfully created port: 4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Cannot resize image /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.objects.instance [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lazy-loading 'migration_context' on Instance uuid b5fe9835-8278-449e-9069-18421cb088dd {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Ensure instance console log exists: /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:19:25 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Creating image(s)
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Ensure instance console log exists: /opt/stack/data/nova/instances/c3a723a9-2a7f-46b9-a326-501d77ad7c16/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Start _get_guest_xml network_info=[{"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '9cf2912b-9e34-413d-9909-1c5d49cbe151', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCOzraS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3a723a9-2a7f-46b9-a326-501d77ad7c16', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb', 'serial': 'f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:19:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 12:19:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lazy-loading 'vcpu_model' on Instance uuid c3a723a9-2a7f-46b9-a326-501d77ad7c16 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCOzraS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:19:25 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:19:25 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:19:25 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b76109-13bf-409e-ac31-3df4767c8ee2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:19:25 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6876bf64-31d8-4704-b2cb-f263f5b3d7a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb] added
Jul 31 12:19:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c24ff8-5410-411c-983e-214c6ef25eec]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd99c4c9-3a15-4d50-aa35-bc30b3100b92]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUCOzraS {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUCOzraS" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[306fc0fa-e521-44d4-9324-1a337bdf3e60]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HUCOzraS'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d49304-1de0-4bbc-aa70-2494b7aaf146]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c944e38-f304-457b-88b2-b20f0618e1c4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:25 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:19:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:25 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:19:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb97143-849e-41bd-9974-1582e04feced]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260]
Jul 31 12:19:25 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260] successful.
Jul 31 12:19:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a1f81d-a31b-4c0e-b902-edc772ea68ef]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e457e2-20eb-41f1-944e-20160608e2d1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:25 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:19:25 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:19:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:25 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:19:25 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:19:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c9d6a3-ce41-4d1b-a1b7-3b70eead95fe]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCOzraS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.network.neutron [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Successfully updated port: 4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "refresh_cache-b5fe9835-8278-449e-9069-18421cb088dd" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquired lock "refresh_cache-b5fe9835-8278-449e-9069-18421cb088dd" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.network.neutron [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-d0c31cdf-a4b2-4fc6-a753-c9b6bb6a135c req-2ba296e7-e25e-4fb8-8cb2-b0a09d80500b service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Received event network-changed-4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-d0c31cdf-a4b2-4fc6-a753-c9b6bb6a135c req-2ba296e7-e25e-4fb8-8cb2-b0a09d80500b service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Refreshing instance network info cache due to event network-changed-4425eb84-e913-4e73-a372-ae2d5862108e. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d0c31cdf-a4b2-4fc6-a753-c9b6bb6a135c req-2ba296e7-e25e-4fb8-8cb2-b0a09d80500b service nova] Acquiring lock "refresh_cache-b5fe9835-8278-449e-9069-18421cb088dd" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:19:25 user nova-compute[72447]: DEBUG nova.network.neutron [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.network.neutron [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Updating instance_info_cache with network_info: [{"id": "4425eb84-e913-4e73-a372-ae2d5862108e", "address": "fa:16:3e:4d:a3:ab", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4425eb84-e9", "ovs_interfaceid": "4425eb84-e913-4e73-a372-ae2d5862108e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Releasing lock "refresh_cache-b5fe9835-8278-449e-9069-18421cb088dd" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Instance network_info: |[{"id": "4425eb84-e913-4e73-a372-ae2d5862108e", "address": "fa:16:3e:4d:a3:ab", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4425eb84-e9", "ovs_interfaceid": "4425eb84-e913-4e73-a372-ae2d5862108e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d0c31cdf-a4b2-4fc6-a753-c9b6bb6a135c req-2ba296e7-e25e-4fb8-8cb2-b0a09d80500b service nova] Acquired lock "refresh_cache-b5fe9835-8278-449e-9069-18421cb088dd" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.network.neutron [req-d0c31cdf-a4b2-4fc6-a753-c9b6bb6a135c req-2ba296e7-e25e-4fb8-8cb2-b0a09d80500b service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Refreshing network info cache for port 4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Start _get_guest_xml network_info=[{"id": "4425eb84-e913-4e73-a372-ae2d5862108e", "address": "fa:16:3e:4d:a3:ab", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4425eb84-e9", "ovs_interfaceid": "4425eb84-e913-4e73-a372-ae2d5862108e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:19:26 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:19:26 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-977941788',display_name='tempest-ServersNegativeTestJSON-server-977941788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-977941788',id=24,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94646a9f184c43d4abbd4fac64c84344',ramdisk_id='',reservation_id='r-cqg7lv8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1687226877',owner_user_name='tempest-ServersNegativeTestJSON-1687226877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:19:24Z,user_data=None,user_id='f2c57df148eb4814a0b12ca7a6d9eda6',uuid=b5fe9835-8278-449e-9069-18421cb088dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4425eb84-e913-4e73-a372-ae2d5862108e", "address": "fa:16:3e:4d:a3:ab", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4425eb84-e9", "ovs_interfaceid": "4425eb84-e913-4e73-a372-ae2d5862108e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Converting VIF {"id": "4425eb84-e913-4e73-a372-ae2d5862108e", "address": "fa:16:3e:4d:a3:ab", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4425eb84-e9", "ovs_interfaceid": "4425eb84-e913-4e73-a372-ae2d5862108e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a3:ab,bridge_name='br-int',has_traffic_filtering=True,id=4425eb84-e913-4e73-a372-ae2d5862108e,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4425eb84-e9') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.objects.instance [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lazy-loading 'pci_devices' on Instance uuid b5fe9835-8278-449e-9069-18421cb088dd {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:19:26 user nova-compute[72447]:   <uuid>b5fe9835-8278-449e-9069-18421cb088dd</uuid>
Jul 31 12:19:26 user nova-compute[72447]:   <name>instance-00000018</name>
Jul 31 12:19:26 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:19:26 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:19:26 user nova-compute[72447]:   <metadata>
Jul 31 12:19:26 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:19:26 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:19:26 user nova-compute[72447]:       <nova:name>tempest-ServersNegativeTestJSON-server-977941788</nova:name>
Jul 31 12:19:26 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:19:26</nova:creationTime>
Jul 31 12:19:26 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:19:26 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:19:26 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:19:26 user nova-compute[72447]:       <nova:owner>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:user uuid="f2c57df148eb4814a0b12ca7a6d9eda6">tempest-ServersNegativeTestJSON-1687226877-project-member</nova:user>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:project uuid="94646a9f184c43d4abbd4fac64c84344">tempest-ServersNegativeTestJSON-1687226877</nova:project>
Jul 31 12:19:26 user nova-compute[72447]:       </nova:owner>
Jul 31 12:19:26 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:19:26 user nova-compute[72447]:       <nova:ports>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:port uuid="4425eb84-e913-4e73-a372-ae2d5862108e">
Jul 31 12:19:26 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 12:19:26 user nova-compute[72447]:         </nova:port>
Jul 31 12:19:26 user nova-compute[72447]:       </nova:ports>
Jul 31 12:19:26 user nova-compute[72447]:     </nova:instance>
Jul 31 12:19:26 user nova-compute[72447]:   </metadata>
Jul 31 12:19:26 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:19:26 user nova-compute[72447]:     <system>
Jul 31 12:19:26 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:19:26 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:19:26 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:19:26 user nova-compute[72447]:       <entry name="serial">b5fe9835-8278-449e-9069-18421cb088dd</entry>
Jul 31 12:19:26 user nova-compute[72447]:       <entry name="uuid">b5fe9835-8278-449e-9069-18421cb088dd</entry>
Jul 31 12:19:26 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:19:26 user nova-compute[72447]:     </system>
Jul 31 12:19:26 user nova-compute[72447]:   </sysinfo>
Jul 31 12:19:26 user nova-compute[72447]:   <os>
Jul 31 12:19:26 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:19:26 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:19:26 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:19:26 user nova-compute[72447]:   </os>
Jul 31 12:19:26 user nova-compute[72447]:   <features>
Jul 31 12:19:26 user nova-compute[72447]:     <acpi/>
Jul 31 12:19:26 user nova-compute[72447]:     <apic/>
Jul 31 12:19:26 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:19:26 user nova-compute[72447]:   </features>
Jul 31 12:19:26 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:19:26 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:19:26 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:19:26 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:19:26 user nova-compute[72447]:   </clock>
Jul 31 12:19:26 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:19:26 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:19:26 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:19:26 user nova-compute[72447]:   </cpu>
Jul 31 12:19:26 user nova-compute[72447]:   <devices>
Jul 31 12:19:26 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:19:26 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:19:26 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk"/>
Jul 31 12:19:26 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:19:26 user nova-compute[72447]:     </disk>
Jul 31 12:19:26 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:19:26 user nova-compute[72447]:       <mac address="fa:16:3e:4d:a3:ab"/>
Jul 31 12:19:26 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:19:26 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:19:26 user nova-compute[72447]:       <target dev="tap4425eb84-e9"/>
Jul 31 12:19:26 user nova-compute[72447]:     </interface>
Jul 31 12:19:26 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:19:26 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/console.log" append="off"/>
Jul 31 12:19:26 user nova-compute[72447]:     </serial>
Jul 31 12:19:26 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:19:26 user nova-compute[72447]:     <video>
Jul 31 12:19:26 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:19:26 user nova-compute[72447]:     </video>
Jul 31 12:19:26 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:19:26 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:19:26 user nova-compute[72447]:     </rng>
Jul 31 12:19:26 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:19:26 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:19:26 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:19:26 user nova-compute[72447]:     </memballoon>
Jul 31 12:19:26 user nova-compute[72447]:   </devices>
Jul 31 12:19:26 user nova-compute[72447]: </domain>
Jul 31 12:19:26 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-977941788',display_name='tempest-ServersNegativeTestJSON-server-977941788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-977941788',id=24,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94646a9f184c43d4abbd4fac64c84344',ramdisk_id='',reservation_id='r-cqg7lv8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1687226877',owner_user_name='tempest-ServersNegativeTestJSON-1687226877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:19:24Z,user_data=None,user_id='f2c57df148eb4814a0b12ca7a6d9eda6',uuid=b5fe9835-8278-449e-9069-18421cb088dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4425eb84-e913-4e73-a372-ae2d5862108e", "address": "fa:16:3e:4d:a3:ab", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4425eb84-e9", "ovs_interfaceid": "4425eb84-e913-4e73-a372-ae2d5862108e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Converting VIF {"id": "4425eb84-e913-4e73-a372-ae2d5862108e", "address": "fa:16:3e:4d:a3:ab", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4425eb84-e9", "ovs_interfaceid": "4425eb84-e913-4e73-a372-ae2d5862108e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a3:ab,bridge_name='br-int',has_traffic_filtering=True,id=4425eb84-e913-4e73-a372-ae2d5862108e,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4425eb84-e9') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG os_vif [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a3:ab,bridge_name='br-int',has_traffic_filtering=True,id=4425eb84-e913-4e73-a372-ae2d5862108e,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4425eb84-e9') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4425eb84-e9, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4425eb84-e9, col_values=(('external_ids', {'iface-id': '4425eb84-e913-4e73-a372-ae2d5862108e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:a3:ab', 'vm-uuid': 'b5fe9835-8278-449e-9069-18421cb088dd'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:26 user nova-compute[72447]: INFO os_vif [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a3:ab,bridge_name='br-int',has_traffic_filtering=True,id=4425eb84-e913-4e73-a372-ae2d5862108e,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4425eb84-e9')
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] No VIF found with MAC fa:16:3e:4d:a3:ab, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23531356231383163', 'path': '/dev/sdd'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531356231383163', 'path': '/dev/sdd'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1499780947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1455078153',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECGXIy4PDnzg6ek+j2HG9HwhyLJVMPlacwsNKl7bNxDhJp0QusrhfASjEy/UNcWcKH7CNfC2QWxQjStvqwQeEecRmaAyf/xqGPScqaT5/FIjyOOce+GAHOyAskfUB7sFg==',key_name='tempest-keypair-1780767399',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:17:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5fefc91464b24c68a6d7f9059ec58b5f',ramdisk_id='',reservation_id='r-fif9fh4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1359270950',owner_user_name='tempest-ServerActionsV293TestJSON-1359270950-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855a22b65634f1690901a5f9be8e885',uuid=c3a723a9-2a7f-46b9-a326-501d77ad7c16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converting VIF {"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:19:26 user nova-compute[72447]:   <uuid>c3a723a9-2a7f-46b9-a326-501d77ad7c16</uuid>
Jul 31 12:19:26 user nova-compute[72447]:   <name>instance-00000013</name>
Jul 31 12:19:26 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:19:26 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:19:26 user nova-compute[72447]:   <metadata>
Jul 31 12:19:26 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:19:26 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:19:26 user nova-compute[72447]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1499780947</nova:name>
Jul 31 12:19:26 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:19:25</nova:creationTime>
Jul 31 12:19:26 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:19:26 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:19:26 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:19:26 user nova-compute[72447]:       <nova:owner>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:user uuid="0855a22b65634f1690901a5f9be8e885">tempest-ServerActionsV293TestJSON-1359270950-project-member</nova:user>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:project uuid="5fefc91464b24c68a6d7f9059ec58b5f">tempest-ServerActionsV293TestJSON-1359270950</nova:project>
Jul 31 12:19:26 user nova-compute[72447]:       </nova:owner>
Jul 31 12:19:26 user nova-compute[72447]:       <nova:ports>
Jul 31 12:19:26 user nova-compute[72447]:         <nova:port uuid="2b84f682-ff0f-447b-ab90-bc71768a0b31">
Jul 31 12:19:26 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 12:19:26 user nova-compute[72447]:         </nova:port>
Jul 31 12:19:26 user nova-compute[72447]:       </nova:ports>
Jul 31 12:19:26 user nova-compute[72447]:     </nova:instance>
Jul 31 12:19:26 user nova-compute[72447]:   </metadata>
Jul 31 12:19:26 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:19:26 user nova-compute[72447]:     <system>
Jul 31 12:19:26 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:19:26 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:19:26 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:19:26 user nova-compute[72447]:       <entry name="serial">c3a723a9-2a7f-46b9-a326-501d77ad7c16</entry>
Jul 31 12:19:26 user nova-compute[72447]:       <entry name="uuid">c3a723a9-2a7f-46b9-a326-501d77ad7c16</entry>
Jul 31 12:19:26 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:19:26 user nova-compute[72447]:     </system>
Jul 31 12:19:26 user nova-compute[72447]:   </sysinfo>
Jul 31 12:19:26 user nova-compute[72447]:   <os>
Jul 31 12:19:26 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:19:26 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:19:26 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:19:26 user nova-compute[72447]:   </os>
Jul 31 12:19:26 user nova-compute[72447]:   <features>
Jul 31 12:19:26 user nova-compute[72447]:     <acpi/>
Jul 31 12:19:26 user nova-compute[72447]:     <apic/>
Jul 31 12:19:26 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:19:26 user nova-compute[72447]:   </features>
Jul 31 12:19:26 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:19:26 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:19:26 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:19:26 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:19:26 user nova-compute[72447]:   </clock>
Jul 31 12:19:26 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:19:26 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:19:26 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:19:26 user nova-compute[72447]:   </cpu>
Jul 31 12:19:26 user nova-compute[72447]:   <devices>
Jul 31 12:19:26 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:19:26 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:19:26 user nova-compute[72447]:       <source dev="/dev/sdd"/>
Jul 31 12:19:26 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:19:26 user nova-compute[72447]:       <serial>f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb</serial>
Jul 31 12:19:26 user nova-compute[72447]:     </disk>
Jul 31 12:19:26 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:19:26 user nova-compute[72447]:       <mac address="fa:16:3e:cb:98:95"/>
Jul 31 12:19:26 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:19:26 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:19:26 user nova-compute[72447]:       <target dev="tap2b84f682-ff"/>
Jul 31 12:19:26 user nova-compute[72447]:     </interface>
Jul 31 12:19:26 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:19:26 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/c3a723a9-2a7f-46b9-a326-501d77ad7c16/console.log" append="off"/>
Jul 31 12:19:26 user nova-compute[72447]:     </serial>
Jul 31 12:19:26 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:19:26 user nova-compute[72447]:     <video>
Jul 31 12:19:26 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:19:26 user nova-compute[72447]:     </video>
Jul 31 12:19:26 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:19:26 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:19:26 user nova-compute[72447]:     </rng>
Jul 31 12:19:26 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:19:26 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:19:26 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:19:26 user nova-compute[72447]:     </memballoon>
Jul 31 12:19:26 user nova-compute[72447]:   </devices>
Jul 31 12:19:26 user nova-compute[72447]: </domain>
Jul 31 12:19:26 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1499780947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1455078153',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECGXIy4PDnzg6ek+j2HG9HwhyLJVMPlacwsNKl7bNxDhJp0QusrhfASjEy/UNcWcKH7CNfC2QWxQjStvqwQeEecRmaAyf/xqGPScqaT5/FIjyOOce+GAHOyAskfUB7sFg==',key_name='tempest-keypair-1780767399',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:17:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5fefc91464b24c68a6d7f9059ec58b5f',ramdisk_id='',reservation_id='r-fif9fh4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1359270950',owner_user_name='tempest-ServerActionsV293TestJSON-1359270950-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855a22b65634f1690901a5f9be8e885',uuid=c3a723a9-2a7f-46b9-a326-501d77ad7c16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converting VIF {"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG os_vif [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b84f682-ff, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b84f682-ff, col_values=(('external_ids', {'iface-id': '2b84f682-ff0f-447b-ab90-bc71768a0b31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:98:95', 'vm-uuid': 'c3a723a9-2a7f-46b9-a326-501d77ad7c16'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:26 user nova-compute[72447]: INFO os_vif [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff')
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:19:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] No VIF found with MAC fa:16:3e:cb:98:95, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:19:27 user nova-compute[72447]: DEBUG nova.network.neutron [req-d0c31cdf-a4b2-4fc6-a753-c9b6bb6a135c req-2ba296e7-e25e-4fb8-8cb2-b0a09d80500b service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Updated VIF entry in instance network info cache for port 4425eb84-e913-4e73-a372-ae2d5862108e. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:19:27 user nova-compute[72447]: DEBUG nova.network.neutron [req-d0c31cdf-a4b2-4fc6-a753-c9b6bb6a135c req-2ba296e7-e25e-4fb8-8cb2-b0a09d80500b service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Updating instance_info_cache with network_info: [{"id": "4425eb84-e913-4e73-a372-ae2d5862108e", "address": "fa:16:3e:4d:a3:ab", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4425eb84-e9", "ovs_interfaceid": "4425eb84-e913-4e73-a372-ae2d5862108e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:19:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d0c31cdf-a4b2-4fc6-a753-c9b6bb6a135c req-2ba296e7-e25e-4fb8-8cb2-b0a09d80500b service nova] Releasing lock "refresh_cache-b5fe9835-8278-449e-9069-18421cb088dd" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-9f5a1e7e-c098-4f50-8f06-29714a590d65 req-a6df481d-a6da-4281-81e3-737aafa0ad1f service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Received event network-vif-plugged-4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9f5a1e7e-c098-4f50-8f06-29714a590d65 req-a6df481d-a6da-4281-81e3-737aafa0ad1f service nova] Acquiring lock "b5fe9835-8278-449e-9069-18421cb088dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9f5a1e7e-c098-4f50-8f06-29714a590d65 req-a6df481d-a6da-4281-81e3-737aafa0ad1f service nova] Lock "b5fe9835-8278-449e-9069-18421cb088dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9f5a1e7e-c098-4f50-8f06-29714a590d65 req-a6df481d-a6da-4281-81e3-737aafa0ad1f service nova] Lock "b5fe9835-8278-449e-9069-18421cb088dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-9f5a1e7e-c098-4f50-8f06-29714a590d65 req-a6df481d-a6da-4281-81e3-737aafa0ad1f service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] No waiting events found dispatching network-vif-plugged-4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:19:28 user nova-compute[72447]: WARNING nova.compute.manager [req-9f5a1e7e-c098-4f50-8f06-29714a590d65 req-a6df481d-a6da-4281-81e3-737aafa0ad1f service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Received unexpected event network-vif-plugged-4425eb84-e913-4e73-a372-ae2d5862108e for instance with vm_state building and task_state spawning.
Jul 31 12:19:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:19:28 user nova-compute[72447]: INFO nova.compute.claims [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Claim successful on node user
Jul 31 12:19:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-0f2d35c8-1e11-4165-b098-ce8fef18efa0 req-8d9bc04a-a641-49d0-bf96-1384718cfa38 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0f2d35c8-1e11-4165-b098-ce8fef18efa0 req-8d9bc04a-a641-49d0-bf96-1384718cfa38 service nova] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0f2d35c8-1e11-4165-b098-ce8fef18efa0 req-8d9bc04a-a641-49d0-bf96-1384718cfa38 service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0f2d35c8-1e11-4165-b098-ce8fef18efa0 req-8d9bc04a-a641-49d0-bf96-1384718cfa38 service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-0f2d35c8-1e11-4165-b098-ce8fef18efa0 req-8d9bc04a-a641-49d0-bf96-1384718cfa38 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] No waiting events found dispatching network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:19:29 user nova-compute[72447]: WARNING nova.compute.manager [req-0f2d35c8-1e11-4165-b098-ce8fef18efa0 req-8d9bc04a-a641-49d0-bf96-1384718cfa38 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received unexpected event network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 for instance with vm_state active and task_state rebuild_spawning.
Jul 31 12:19:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.754s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:19:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:19:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG nova.policy [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbcdd571b45b4450a8b27b834a05a2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9576e1abb5b1475da061ca824d7c3788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:19:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Creating image(s)
Jul 31 12:19:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "/opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "/opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "/opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk 1073741824" returned: 0 in 0.048s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.168s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Checking if we can resize image /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Successfully created port: 8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Cannot resize image /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG nova.objects.instance [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'migration_context' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Ensure instance console log exists: /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-1be328c2-ce4c-45ef-95ac-e408ed0ba99a req-1bdb73fd-7086-44d7-bd84-29735cab2084 service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Received event network-vif-plugged-4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1be328c2-ce4c-45ef-95ac-e408ed0ba99a req-1bdb73fd-7086-44d7-bd84-29735cab2084 service nova] Acquiring lock "b5fe9835-8278-449e-9069-18421cb088dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1be328c2-ce4c-45ef-95ac-e408ed0ba99a req-1bdb73fd-7086-44d7-bd84-29735cab2084 service nova] Lock "b5fe9835-8278-449e-9069-18421cb088dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1be328c2-ce4c-45ef-95ac-e408ed0ba99a req-1bdb73fd-7086-44d7-bd84-29735cab2084 service nova] Lock "b5fe9835-8278-449e-9069-18421cb088dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-1be328c2-ce4c-45ef-95ac-e408ed0ba99a req-1bdb73fd-7086-44d7-bd84-29735cab2084 service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] No waiting events found dispatching network-vif-plugged-4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:19:30 user nova-compute[72447]: WARNING nova.compute.manager [req-1be328c2-ce4c-45ef-95ac-e408ed0ba99a req-1bdb73fd-7086-44d7-bd84-29735cab2084 service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Received unexpected event network-vif-plugged-4425eb84-e913-4e73-a372-ae2d5862108e for instance with vm_state building and task_state spawning.
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-b4ea047c-c020-44e9-bda1-3ed13f5401d5 req-d9ea60e5-059e-4a38-befa-8b778d99edbe service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b4ea047c-c020-44e9-bda1-3ed13f5401d5 req-d9ea60e5-059e-4a38-befa-8b778d99edbe service nova] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b4ea047c-c020-44e9-bda1-3ed13f5401d5 req-d9ea60e5-059e-4a38-befa-8b778d99edbe service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b4ea047c-c020-44e9-bda1-3ed13f5401d5 req-d9ea60e5-059e-4a38-befa-8b778d99edbe service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-b4ea047c-c020-44e9-bda1-3ed13f5401d5 req-d9ea60e5-059e-4a38-befa-8b778d99edbe service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] No waiting events found dispatching network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:19:31 user nova-compute[72447]: WARNING nova.compute.manager [req-b4ea047c-c020-44e9-bda1-3ed13f5401d5 req-d9ea60e5-059e-4a38-befa-8b778d99edbe service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received unexpected event network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 for instance with vm_state active and task_state rebuild_spawning.
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Successfully updated port: 8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquired lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-67e91876-ce17-4d36-9769-be5ae4ba82a8 req-0c767b29-3f66-4934-ba1c-6c734cc41e87 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-changed-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-67e91876-ce17-4d36-9769-be5ae4ba82a8 req-0c767b29-3f66-4934-ba1c-6c734cc41e87 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Refreshing instance network info cache due to event network-changed-8cdc2eae-9d44-4619-ad18-98196a439f15. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-67e91876-ce17-4d36-9769-be5ae4ba82a8 req-0c767b29-3f66-4934-ba1c-6c734cc41e87 service nova] Acquiring lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805971.4413335, c3a723a9-2a7f-46b9-a326-501d77ad7c16 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:19:31 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] VM Resumed (Lifecycle Event)
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:19:31 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Instance spawned successfully.
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:31 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Instance spawned successfully.
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:31 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805971.4434059, b5fe9835-8278-449e-9069-18421cb088dd => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:19:31 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b5fe9835-8278-449e-9069-18421cb088dd] VM Resumed (Lifecycle Event)
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:31 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b5fe9835-8278-449e-9069-18421cb088dd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805971.4489238, c3a723a9-2a7f-46b9-a326-501d77ad7c16 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:19:31 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] VM Started (Lifecycle Event)
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updating instance_info_cache with network_info: [{"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:19:31 user nova-compute[72447]: INFO nova.compute.manager [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Took 7.26 seconds to spawn the instance on the hypervisor.
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Releasing lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Instance network_info: |[{"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-67e91876-ce17-4d36-9769-be5ae4ba82a8 req-0c767b29-3f66-4934-ba1c-6c734cc41e87 service nova] Acquired lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-67e91876-ce17-4d36-9769-be5ae4ba82a8 req-0c767b29-3f66-4934-ba1c-6c734cc41e87 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Refreshing network info cache for port 8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Start _get_guest_xml network_info=[{"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:31 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:19:31 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72447) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1804070957',display_name='tempest-ServerRescueNegativeTestJSON-server-1804070957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1804070957',id=25,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU7ZXwiFgzMg8a44RrreO/XqYZIUmOE9iTP5kDtijALfeDKpqhlIcg6kobJqoZmCLWC/4Ey6eC7psG7UL1cAoLuos4YGl7QXWEIFfzxxS7LeUI4v+hNMWA7z/BWm7VB9w==',key_name='tempest-keypair-1226214134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9576e1abb5b1475da061ca824d7c3788',ramdisk_id='',reservation_id='r-fjjnoqc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2103641702',owner_user_name='tempest-ServerRescueNegativeTestJSON-2103641702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:19:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbcdd571b45b4450a8b27b834a05a2b6',uuid=483f6f7a-c61d-46dd-893b-29b80da3f54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converting VIF {"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:0f,bridge_name='br-int',has_traffic_filtering=True,id=8cdc2eae-9d44-4619-ad18-98196a439f15,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdc2eae-9d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.objects.instance [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'pci_devices' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805971.450613, b5fe9835-8278-449e-9069-18421cb088dd => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:19:31 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b5fe9835-8278-449e-9069-18421cb088dd] VM Started (Lifecycle Event)
Jul 31 12:19:31 user nova-compute[72447]: INFO nova.compute.manager [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Took 8.16 seconds to build instance.
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:19:31 user nova-compute[72447]:   <uuid>483f6f7a-c61d-46dd-893b-29b80da3f54d</uuid>
Jul 31 12:19:31 user nova-compute[72447]:   <name>instance-00000019</name>
Jul 31 12:19:31 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:19:31 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:19:31 user nova-compute[72447]:   <metadata>
Jul 31 12:19:31 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:19:31 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:19:31 user nova-compute[72447]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1804070957</nova:name>
Jul 31 12:19:31 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:19:31</nova:creationTime>
Jul 31 12:19:31 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:19:31 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:19:31 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:19:31 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:19:31 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:19:31 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:19:31 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:19:31 user nova-compute[72447]:       <nova:owner>
Jul 31 12:19:31 user nova-compute[72447]:         <nova:user uuid="cbcdd571b45b4450a8b27b834a05a2b6">tempest-ServerRescueNegativeTestJSON-2103641702-project-member</nova:user>
Jul 31 12:19:31 user nova-compute[72447]:         <nova:project uuid="9576e1abb5b1475da061ca824d7c3788">tempest-ServerRescueNegativeTestJSON-2103641702</nova:project>
Jul 31 12:19:31 user nova-compute[72447]:       </nova:owner>
Jul 31 12:19:31 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:19:31 user nova-compute[72447]:       <nova:ports>
Jul 31 12:19:31 user nova-compute[72447]:         <nova:port uuid="8cdc2eae-9d44-4619-ad18-98196a439f15">
Jul 31 12:19:31 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 12:19:31 user nova-compute[72447]:         </nova:port>
Jul 31 12:19:31 user nova-compute[72447]:       </nova:ports>
Jul 31 12:19:31 user nova-compute[72447]:     </nova:instance>
Jul 31 12:19:31 user nova-compute[72447]:   </metadata>
Jul 31 12:19:31 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:19:31 user nova-compute[72447]:     <system>
Jul 31 12:19:31 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:19:31 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:19:31 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:19:31 user nova-compute[72447]:       <entry name="serial">483f6f7a-c61d-46dd-893b-29b80da3f54d</entry>
Jul 31 12:19:31 user nova-compute[72447]:       <entry name="uuid">483f6f7a-c61d-46dd-893b-29b80da3f54d</entry>
Jul 31 12:19:31 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:19:31 user nova-compute[72447]:     </system>
Jul 31 12:19:31 user nova-compute[72447]:   </sysinfo>
Jul 31 12:19:31 user nova-compute[72447]:   <os>
Jul 31 12:19:31 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:19:31 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:19:31 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:19:31 user nova-compute[72447]:   </os>
Jul 31 12:19:31 user nova-compute[72447]:   <features>
Jul 31 12:19:31 user nova-compute[72447]:     <acpi/>
Jul 31 12:19:31 user nova-compute[72447]:     <apic/>
Jul 31 12:19:31 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:19:31 user nova-compute[72447]:   </features>
Jul 31 12:19:31 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:19:31 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:19:31 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:19:31 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:19:31 user nova-compute[72447]:   </clock>
Jul 31 12:19:31 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:19:31 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:19:31 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:19:31 user nova-compute[72447]:   </cpu>
Jul 31 12:19:31 user nova-compute[72447]:   <devices>
Jul 31 12:19:31 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:19:31 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:19:31 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk"/>
Jul 31 12:19:31 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:19:31 user nova-compute[72447]:     </disk>
Jul 31 12:19:31 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:19:31 user nova-compute[72447]:       <mac address="fa:16:3e:53:b0:0f"/>
Jul 31 12:19:31 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:19:31 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:19:31 user nova-compute[72447]:       <target dev="tap8cdc2eae-9d"/>
Jul 31 12:19:31 user nova-compute[72447]:     </interface>
Jul 31 12:19:31 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:19:31 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/console.log" append="off"/>
Jul 31 12:19:31 user nova-compute[72447]:     </serial>
Jul 31 12:19:31 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:19:31 user nova-compute[72447]:     <video>
Jul 31 12:19:31 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:19:31 user nova-compute[72447]:     </video>
Jul 31 12:19:31 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:19:31 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:19:31 user nova-compute[72447]:     </rng>
Jul 31 12:19:31 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:19:31 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:19:31 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:19:31 user nova-compute[72447]:     </memballoon>
Jul 31 12:19:31 user nova-compute[72447]:   </devices>
Jul 31 12:19:31 user nova-compute[72447]: </domain>
Jul 31 12:19:31 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1804070957',display_name='tempest-ServerRescueNegativeTestJSON-server-1804070957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1804070957',id=25,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU7ZXwiFgzMg8a44RrreO/XqYZIUmOE9iTP5kDtijALfeDKpqhlIcg6kobJqoZmCLWC/4Ey6eC7psG7UL1cAoLuos4YGl7QXWEIFfzxxS7LeUI4v+hNMWA7z/BWm7VB9w==',key_name='tempest-keypair-1226214134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9576e1abb5b1475da061ca824d7c3788',ramdisk_id='',reservation_id='r-fjjnoqc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2103641702',owner_user_name='tempest-ServerRescueNegativeTestJSON-2103641702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:19:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbcdd571b45b4450a8b27b834a05a2b6',uuid=483f6f7a-c61d-46dd-893b-29b80da3f54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converting VIF {"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:0f,bridge_name='br-int',has_traffic_filtering=True,id=8cdc2eae-9d44-4619-ad18-98196a439f15,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdc2eae-9d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG os_vif [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:0f,bridge_name='br-int',has_traffic_filtering=True,id=8cdc2eae-9d44-4619-ad18-98196a439f15,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdc2eae-9d') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cdc2eae-9d, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8cdc2eae-9d, col_values=(('external_ids', {'iface-id': '8cdc2eae-9d44-4619-ad18-98196a439f15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:b0:0f', 'vm-uuid': '483f6f7a-c61d-46dd-893b-29b80da3f54d'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fd8d5551-67af-4d8e-a5b4-56f4e8503a67 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.094s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-912f51c4-c0de-48fa-98f3-8f3b49f8e194 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "b5fe9835-8278-449e-9069-18421cb088dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.289s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:31 user nova-compute[72447]: INFO os_vif [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:0f,bridge_name='br-int',has_traffic_filtering=True,id=8cdc2eae-9d44-4619-ad18-98196a439f15,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdc2eae-9d')
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:19:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No VIF found with MAC fa:16:3e:53:b0:0f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:19:32 user nova-compute[72447]: DEBUG nova.network.neutron [req-67e91876-ce17-4d36-9769-be5ae4ba82a8 req-0c767b29-3f66-4934-ba1c-6c734cc41e87 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updated VIF entry in instance network info cache for port 8cdc2eae-9d44-4619-ad18-98196a439f15. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:19:32 user nova-compute[72447]: DEBUG nova.network.neutron [req-67e91876-ce17-4d36-9769-be5ae4ba82a8 req-0c767b29-3f66-4934-ba1c-6c734cc41e87 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updating instance_info_cache with network_info: [{"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:19:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-67e91876-ce17-4d36-9769-be5ae4ba82a8 req-0c767b29-3f66-4934-ba1c-6c734cc41e87 service nova] Releasing lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:19:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-d86b737c-5084-4e28-bdce-19cbd3a6e9a0 req-d8412197-5d59-48bb-8c96-5c32f6ec2231 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:19:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d86b737c-5084-4e28-bdce-19cbd3a6e9a0 req-d8412197-5d59-48bb-8c96-5c32f6ec2231 service nova] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d86b737c-5084-4e28-bdce-19cbd3a6e9a0 req-d8412197-5d59-48bb-8c96-5c32f6ec2231 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d86b737c-5084-4e28-bdce-19cbd3a6e9a0 req-d8412197-5d59-48bb-8c96-5c32f6ec2231 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-d86b737c-5084-4e28-bdce-19cbd3a6e9a0 req-d8412197-5d59-48bb-8c96-5c32f6ec2231 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] No waiting events found dispatching network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:19:33 user nova-compute[72447]: WARNING nova.compute.manager [req-d86b737c-5084-4e28-bdce-19cbd3a6e9a0 req-d8412197-5d59-48bb-8c96-5c32f6ec2231 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received unexpected event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 for instance with vm_state building and task_state spawning.
Jul 31 12:19:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-a97ec2b0-1274-4ec5-bb9e-d0b76fa3962c req-f7c26da6-1e08-4b31-9ed7-05bc089a61f7 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Received event network-changed-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-a97ec2b0-1274-4ec5-bb9e-d0b76fa3962c req-f7c26da6-1e08-4b31-9ed7-05bc089a61f7 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Refreshing instance network info cache due to event network-changed-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a97ec2b0-1274-4ec5-bb9e-d0b76fa3962c req-f7c26da6-1e08-4b31-9ed7-05bc089a61f7 service nova] Acquiring lock "refresh_cache-08c02c81-b860-45e8-a4e0-126b2151c601" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a97ec2b0-1274-4ec5-bb9e-d0b76fa3962c req-f7c26da6-1e08-4b31-9ed7-05bc089a61f7 service nova] Acquired lock "refresh_cache-08c02c81-b860-45e8-a4e0-126b2151c601" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.network.neutron [req-a97ec2b0-1274-4ec5-bb9e-d0b76fa3962c req-f7c26da6-1e08-4b31-9ed7-05bc089a61f7 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Refreshing network info cache for port ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-1807b059-d2ae-4c20-8a32-40a2b30f3329 req-205ddeae-4745-4e35-97fb-7f52fc865514 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1807b059-d2ae-4c20-8a32-40a2b30f3329 req-205ddeae-4745-4e35-97fb-7f52fc865514 service nova] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1807b059-d2ae-4c20-8a32-40a2b30f3329 req-205ddeae-4745-4e35-97fb-7f52fc865514 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1807b059-d2ae-4c20-8a32-40a2b30f3329 req-205ddeae-4745-4e35-97fb-7f52fc865514 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-1807b059-d2ae-4c20-8a32-40a2b30f3329 req-205ddeae-4745-4e35-97fb-7f52fc865514 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] No waiting events found dispatching network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:19:35 user nova-compute[72447]: WARNING nova.compute.manager [req-1807b059-d2ae-4c20-8a32-40a2b30f3329 req-205ddeae-4745-4e35-97fb-7f52fc865514 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received unexpected event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 for instance with vm_state building and task_state spawning.
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.network.neutron [req-a97ec2b0-1274-4ec5-bb9e-d0b76fa3962c req-f7c26da6-1e08-4b31-9ed7-05bc089a61f7 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Updated VIF entry in instance network info cache for port ae0af4fb-e6c1-4711-a186-c8eee0acf7cd. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.network.neutron [req-a97ec2b0-1274-4ec5-bb9e-d0b76fa3962c req-f7c26da6-1e08-4b31-9ed7-05bc089a61f7 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Updating instance_info_cache with network_info: [{"id": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "address": "fa:16:3e:ef:a6:a1", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0af4fb-e6", "ovs_interfaceid": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a97ec2b0-1274-4ec5-bb9e-d0b76fa3962c req-f7c26da6-1e08-4b31-9ed7-05bc089a61f7 service nova] Releasing lock "refresh_cache-08c02c81-b860-45e8-a4e0-126b2151c601" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805975.5432339, 483f6f7a-c61d-46dd-893b-29b80da3f54d => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:19:35 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] VM Resumed (Lifecycle Event)
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:19:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Instance spawned successfully.
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:19:35 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690805975.546488, 483f6f7a-c61d-46dd-893b-29b80da3f54d => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:19:35 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] VM Started (Lifecycle Event)
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:19:35 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:19:35 user nova-compute[72447]: INFO nova.compute.manager [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Took 5.86 seconds to spawn the instance on the hypervisor.
Jul 31 12:19:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:19:35 user nova-compute[72447]: INFO nova.compute.manager [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Took 6.96 seconds to build instance.
Jul 31 12:19:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7d1548-45ad-4921-8ea5-2aa2cfdf568b tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.107s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "08c02c81-b860-45e8-a4e0-126b2151c601" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "08c02c81-b860-45e8-a4e0-126b2151c601" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:39 user nova-compute[72447]: DEBUG nova.objects.instance [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'flavor' on Instance uuid 08c02c81-b860-45e8-a4e0-126b2151c601 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:19:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "08c02c81-b860-45e8-a4e0-126b2151c601" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "08c02c81-b860-45e8-a4e0-126b2151c601" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "08c02c81-b860-45e8-a4e0-126b2151c601" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:40 user nova-compute[72447]: INFO nova.compute.manager [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Attaching volume 3e311c12-5f3d-4325-a106-9370ba78e672 to /dev/vdb
Jul 31 12:19:40 user nova-compute[72447]: DEBUG os_brick.utils [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[508f0037-e10a-4697-9d8c-35f41c560f7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1343805-aa1d-40c6-8b7a-6dc5b5fc7798]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c7e873-5b91-4add-afd9-84fe7d64825f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4178471c-435c-42e0-b159-89728c416eea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:19:40 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:19:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aa4800-fece-4b3c-a6c7-51c2b2d19776]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG os_brick.utils [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:19:40 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Updating existing volume attachment record: 389a889b-901d-47e1-8bc3-c46716be759b {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:19:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHfTxoYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:19:47 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:19:47 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:19:47 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[531d7358-c4c2-4a08-b126-e1b6dbabfcde]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:19:47 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9e69e4-d8c3-4ff7-9be8-86b77fbdb1e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672] added
Jul 31 12:19:47 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dc11d9-dc12-48ef-8e86-77385289b0f6]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3104b26-9f8d-49a4-a5c0-79b54ed94110]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHfTxoYu {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHfTxoYu" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcb955b-6845-4456-84a6-83dc7e0c8101]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZHfTxoYu'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8187d2e3-c929-4a42-b649-c589ae3c7b04]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfded05-222c-4727-8177-9299b6c547ff]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:47 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:19:47 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:19:47 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:47 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:19:47 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:19:47 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:19:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6d0e1e-775c-4a82-acab-c853221879cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672, portal: 172.16.0.220,3260]
Jul 31 12:19:48 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672, portal: 172.16.0.220,3260] successful.
Jul 31 12:19:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9831df9e-0aa7-4c84-aa1b-cdcf2455aeff]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef1cb5e-7cf4-4a49-88d9-95440d8004d6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:48 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:19:48 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:19:48 user nova-compute[72447]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 (non-flash)
Jul 31 12:19:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:48 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:19:48 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:19:48 user nova-compute[72447]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 (non-flash)
Jul 31 12:19:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee61ed0-3433-4824-bdb0-ff82d8b1bf7b]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHfTxoYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Updating instance_info_cache with network_info: [{"id": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "address": "fa:16:3e:4e:fc:4a", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a18de-e6", "ovs_interfaceid": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:19:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:19:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:19:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26162393434316262', 'path': '/dev/sde'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:19:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162393434316262', 'path': '/dev/sde'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:19:49 user nova-compute[72447]: DEBUG nova.objects.instance [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'flavor' on Instance uuid 08c02c81-b860-45e8-a4e0-126b2151c601 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:19:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:19:49 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:19:49 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:19:49 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:19:49 user nova-compute[72447]:   <serial>3e311c12-5f3d-4325-a106-9370ba78e672</serial>
Jul 31 12:19:49 user nova-compute[72447]: </disk>
Jul 31 12:19:49 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:19:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:19:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:19:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No VIF found with MAC fa:16:3e:ef:a6:a1, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:19:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-287da3a1-5a4e-4015-bab4-72cd510144c7 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "08c02c81-b860-45e8-a4e0-126b2151c601" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.740s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:50 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:19:50 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:19:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "08c02c81-b860-45e8-a4e0-126b2151c601" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "08c02c81-b860-45e8-a4e0-126b2151c601" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:51 user nova-compute[72447]: INFO nova.compute.manager [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Detaching volume 3e311c12-5f3d-4325-a106-9370ba78e672
Jul 31 12:19:51 user nova-compute[72447]: INFO nova.virt.block_device [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Attempting to driver detach volume 3e311c12-5f3d-4325-a106-9370ba78e672 from mountpoint /dev/vdb
Jul 31 12:19:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Attempting to detach device vdb from instance 08c02c81-b860-45e8-a4e0-126b2151c601 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:19:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:19:51 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:19:51 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:19:51 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:19:51 user nova-compute[72447]:   <serial>3e311c12-5f3d-4325-a106-9370ba78e672</serial>
Jul 31 12:19:51 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:19:51 user nova-compute[72447]: </disk>
Jul 31 12:19:51 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:19:51 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully detached device vdb from instance 08c02c81-b860-45e8-a4e0-126b2151c601 from the persistent domain config.
Jul 31 12:19:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08c02c81-b860-45e8-a4e0-126b2151c601 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:19:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:19:51 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:19:51 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:19:51 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:19:51 user nova-compute[72447]:   <serial>3e311c12-5f3d-4325-a106-9370ba78e672</serial>
Jul 31 12:19:51 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:19:51 user nova-compute[72447]: </disk>
Jul 31 12:19:51 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:19:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690805992.0627623, 08c02c81-b860-45e8-a4e0-126b2151c601 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08c02c81-b860-45e8-a4e0-126b2151c601 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:19:52 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully detached device vdb from instance 08c02c81-b860-45e8-a4e0-126b2151c601 from the live domain config.
Jul 31 12:19:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHfTxoYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:19:52 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2109be-0ef7-4e96-b21f-1cf1c1f9cdbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b2050e-bbce-4e14-aca8-1fd13f0b0058]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:52 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:19:52 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:19:52 user nova-compute[72447]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 (non-flash)
Jul 31 12:19:52 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:19:52 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:19:52 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:19:52 user nova-compute[72447]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 (non-flash)
Jul 31 12:19:52 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f066858d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672'): ({'sde'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Removing single pathed devices sde {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b564b07-7d55-4d3c-bf88-a8a0ddc5dc6c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6537b96d-5489-48c7-81a5-e32eef6e7876]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Flushing IO for device /dev/sde {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff65db76-6f1f-40ab-9287-9bb9af18aba7]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4c3665-78c0-476e-a79b-261cde45810f]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[227bb1c5-c031-45f5-a59c-7df097fec5c0]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[19948141-d42f-4092-b37d-f590949f1e1d]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672, portal: 172.16.0.220,3260]
Jul 31 12:19:52 user nova-compute[72447]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672, portal: 172.16.0.220,3260] successful.
Jul 31 12:19:52 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e311c12-5f3d-4325-a106-9370ba78e672 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b34fd6-0219-48dc-940e-e8a3c510815e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] <== disconnect_volume: return (288ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG nova.objects.instance [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'flavor' on Instance uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:52 user nova-compute[72447]: INFO nova.compute.manager [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Attaching volume bfb2e0a0-6d39-4cee-babb-47946fde6943 to /dev/vdb
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.utils [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c3d453-b363-4887-9071-e827f0230a50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fe6fee-8155-44f2-8706-e82760210049]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb17be3-61ca-45b6-84c9-4facf5e5282b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[645f9c2c-aedf-41ef-9708-6619fe003c2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:19:52 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:19:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe76846-b35f-4e9d-a3a1-4081a0379b37]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG os_brick.utils [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:19:52 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updating existing volume attachment record: 1abcaa42-4b0b-4499-afa7-57422c6293e6 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'flavor' on Instance uuid 08c02c81-b860-45e8-a4e0-126b2151c601 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0499d3f8-4b15-4736-a994-d509f2c9a249 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "08c02c81-b860-45e8-a4e0-126b2151c601" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.600s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'flavor' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:53 user nova-compute[72447]: INFO nova.compute.manager [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Attaching volume ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc to /dev/vdb
Jul 31 12:19:53 user nova-compute[72447]: DEBUG os_brick.utils [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5467cddc-6002-48cf-93a2-d3ff7c1b7e50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5832f640-4835-427f-bfef-405469ce172e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b25490-cd11-48b8-9e47-a77c036eebb2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2d7fcd-ab29-4e8f-9435-d99061eb54be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:19:53 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:19:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6752c9-7adc-4b2e-bb67-637b211c852c]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG os_brick.utils [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:19:53 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating existing volume attachment record: 0d0e9182-cfef-49ec-8296-83e053493c95 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:19:54 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:19:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:19:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:55 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:19:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:19:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:19:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:19:55 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:19:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:19:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:19:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:19:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:19:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:19:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:19:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:00 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:20:00 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=6721MB free_disk=25.222736358642578GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2f98bc8b-537a-4b34-85ce-d7baac240046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 92ff498b-1337-47da-aaf1-b5fb9f19e98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance e75d2046-19d7-46b8-9c63-5af205c87c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance c3a723a9-2a7f-46b9-a326-501d77ad7c16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 08c02c81-b860-45e8-a4e0-126b2151c601 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 87220d5b-df7b-4664-a5e8-088157130701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b291ba57-9fdb-48f2-ac0c-45a108dda3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b5fe9835-8278-449e-9069-18421cb088dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 483f6f7a-c61d-46dd-893b-29b80da3f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsHgfpdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:00 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:00 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:00 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ef59a8-6276-4904-90e3-3c4fab70ddea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:20:00 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef25cf2b-ad1f-4ddf-8575-0f1f5725b735]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943] added
Jul 31 12:20:00 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a56b20f-a47f-4c62-b7e5-c6402bd96eac]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[153c603d-3fa9-419c-83de-5811c63c9821]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VsHgfpdC {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VsHgfpdC" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbb6029-f38e-4715-a7c0-29f6fa2d1cc1]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VsHgfpdC'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9d3217-f024-4f5f-a725-e96c911c73cf]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6ef3f4-178f-4fab-8829-173be9766407]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:00 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:00 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:00 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:00 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:00 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:00 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.668s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --login" returned: 0 in 0.147s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b1dc6-68ad-47a2-a801-ef3520b03ec4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260]
Jul 31 12:20:00 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260] successful.
Jul 31 12:20:00 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[270ca525-002b-40b2-a376-3b11fd500dd5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[671f310b-0c6a-477e-a2a4-5565a1ac704c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:01 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:01 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:01 user nova-compute[72447]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:01 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:01 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:01 user nova-compute[72447]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdd31ed-0279-4f53-82db-ff006e580da8]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsHgfpdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSZgmNxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:01 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:20:01 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26137636431333432', 'path': '/dev/sde'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137636431333432', 'path': '/dev/sde'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.568s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:02 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:02 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG nova.objects.instance [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'flavor' on Instance uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7558592e-70dc-4fcf-9171-b30ca33b8f9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:20:02 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:20:02 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:20:02 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:20:02 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:20:02 user nova-compute[72447]:   <serial>bfb2e0a0-6d39-4cee-babb-47946fde6943</serial>
Jul 31 12:20:02 user nova-compute[72447]: </disk>
Jul 31 12:20:02 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[533a4585-63ff-4533-84ed-148a3fb39c42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc] added
Jul 31 12:20:02 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4212656-27b1-4fbc-81ea-c434f75bc707]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c478faf-043c-4906-a162-5072e528d52b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSZgmNxe {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSZgmNxe" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[63108f21-4cba-46da-8063-7eae9fe8c29e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kSZgmNxe'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd168894-f541-417c-9806-c30546ea0c82]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7033d8a3-414e-4810-8cbd-1f67e599444d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:02 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:02 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[535f3220-ec76-41d2-936f-ae0db3f7b8dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260]
Jul 31 12:20:02 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260] successful.
Jul 31 12:20:02 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[717bbac2-06b0-43aa-8e4f-b193e4db4481]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e216286-af73-48df-8692-2f510ec86274]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:02 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:02 user nova-compute[72447]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:02 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0da385e-bb85-4f6e-bfc4-f95e3a79b352]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSZgmNxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] No VIF found with MAC fa:16:3e:8c:ca:e2, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:20:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-109d85bd-9e1d-4b1a-8974-47fb5893fbdd tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.903s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] <== connect_volume: return (1871ms) {'type': 'block', 'scsi_wwn': '23561626661346564', 'path': '/dev/sdf'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561626661346564', 'path': '/dev/sdf'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:20:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'flavor' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:20:03 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:20:03 user nova-compute[72447]:   <source dev="/dev/sdf"/>
Jul 31 12:20:03 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:20:03 user nova-compute[72447]:   <serial>ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc</serial>
Jul 31 12:20:03 user nova-compute[72447]: </disk>
Jul 31 12:20:03 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:20:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:20:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:20:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] No VIF found with MAC fa:16:3e:f8:df:6b, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:20:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-bc529aea-4758-475b-9129-65a3aa8942d3 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.613s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:04 user nova-compute[72447]: INFO nova.compute.manager [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Rebuilding instance
Jul 31 12:20:04 user nova-compute[72447]: DEBUG nova.objects.instance [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'trusted_certs' on Instance uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG nova.objects.instance [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'pci_requests' on Instance uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG nova.objects.instance [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'pci_devices' on Instance uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG nova.objects.instance [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'resources' on Instance uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG nova.objects.instance [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'migration_context' on Instance uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG nova.objects.instance [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72447) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-65f19e5d-6990-4707-8155-9074d6a0c85c req-6310b638-571c-4ec2-969d-5c646db34555 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-vif-unplugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-65f19e5d-6990-4707-8155-9074d6a0c85c req-6310b638-571c-4ec2-969d-5c646db34555 service nova] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-65f19e5d-6990-4707-8155-9074d6a0c85c req-6310b638-571c-4ec2-969d-5c646db34555 service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-65f19e5d-6990-4707-8155-9074d6a0c85c req-6310b638-571c-4ec2-969d-5c646db34555 service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-65f19e5d-6990-4707-8155-9074d6a0c85c req-6310b638-571c-4ec2-969d-5c646db34555 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] No waiting events found dispatching network-vif-unplugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:04 user nova-compute[72447]: WARNING nova.compute.manager [req-65f19e5d-6990-4707-8155-9074d6a0c85c req-6310b638-571c-4ec2-969d-5c646db34555 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received unexpected event network-vif-unplugged-fe243daf-4d07-48dd-84c9-1252c65085ed for instance with vm_state active and task_state rebuilding.
Jul 31 12:20:05 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Instance destroyed successfully.
Jul 31 12:20:05 user nova-compute[72447]: INFO nova.compute.manager [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Detaching volume bfb2e0a0-6d39-4cee-babb-47946fde6943
Jul 31 12:20:05 user nova-compute[72447]: INFO nova.virt.block_device [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Attempting to driver detach volume bfb2e0a0-6d39-4cee-babb-47946fde6943 from mountpoint /dev/vdb
Jul 31 12:20:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Attempting to detach device vdb from instance 51310b38-96e0-4d44-ab1e-8d2cc039617e from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:20:05 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:20:05 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:20:05 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:20:05 user nova-compute[72447]:   <serial>bfb2e0a0-6d39-4cee-babb-47946fde6943</serial>
Jul 31 12:20:05 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:20:05 user nova-compute[72447]: </disk>
Jul 31 12:20:05 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:20:05 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Successfully detached device vdb from instance 51310b38-96e0-4d44-ab1e-8d2cc039617e from the persistent domain config.
Jul 31 12:20:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsHgfpdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:05 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dd5593-abcd-4134-85fc-b392118e1af6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cf1803-cdfe-4399-abea-bbe147367776]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:05 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:05 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:05 user nova-compute[72447]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:05 user nova-compute[72447]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:05 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:05 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:05 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:05 user nova-compute[72447]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:05 user nova-compute[72447]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:05 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f067c3cd240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943'): ({'sde'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Removing single pathed devices sde {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2eb317-e704-4a40-aed1-3c1ea4f3e04e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[294e41b5-f0dc-4724-a19a-8e51c6594473]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Flushing IO for device /dev/sde {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc53efb-e00d-4097-9601-9960a6e2d4af]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1916b26-5415-45f8-b07a-79448ed86ee8]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb3dab8-da34-4282-8bad-1e396543a5af]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4279606a-627d-4585-85ba-f4207cf4d864]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260]
Jul 31 12:20:05 user nova-compute[72447]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260] successful.
Jul 31 12:20:05 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Stashing vm_state: active {{(pid=72447) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4338d492-e444-4562-9325-01cb34d3e481]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== disconnect_volume: return (304ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG nova.objects.instance [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'pci_requests' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:20:05 user nova-compute[72447]: INFO nova.compute.claims [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Claim successful on node user
Jul 31 12:20:05 user nova-compute[72447]: DEBUG nova.objects.instance [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'resources' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:05 user nova-compute[72447]: DEBUG nova.objects.instance [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'pci_devices' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:05 user nova-compute[72447]: INFO nova.compute.resource_tracker [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating resource usage from migration 1e8c9167-6f72-47da-b260-8c1b3375469d
Jul 31 12:20:06 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.528s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:06 user nova-compute[72447]: INFO nova.compute.manager [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Migrating
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:20:06 user nova-compute[72447]: INFO nova.compute.rpcapi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquired lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:20:06 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Instance destroyed successfully.
Jul 31 12:20:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-615647500',display_name='tempest-ServerActionsTestOtherA-server-1623510083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-615647500',id=16,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWDGihKbMeCNvBwsaW6V6P8R5lowbGENHMAc92pWv6O2vQFLobOnEOvb/OjxIDRXej4CqXst6J0oTtwIiGi8MF4pETlYJBg2aTwKoMBAuzDXV9HfutMu8dkCAol0vT0Q==',key_name='tempest-keypair-1212175094',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:16:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='25afa936e9674cce91443f7bef7409ab',ramdisk_id='',reservation_id='r-9wvn7yz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1904418117',owner_user_name='tempest-ServerActionsTestOtherA-1904418117-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:20:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfd7290fb1a45b7a27cfb5faa08cc5d',uuid=51310b38-96e0-4d44-ab1e-8d2cc039617e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converting VIF {"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_vif [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe243daf-4d, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:06 user nova-compute[72447]: INFO os_vif [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d')
Jul 31 12:20:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsHgfpdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:06 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[beac8730-0e4a-4bf2-8ad6-f05b3fbf989b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cb47ec-952d-4138-80b2-9e56a35a9d3f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:06 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:06 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:06 user nova-compute[72447]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:06 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:06 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:06 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:06 user nova-compute[72447]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:06 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06687b3880>, {}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Disconnecting from: [] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.059s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== disconnect_volume: return (60ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:20:06 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Deleting instance files /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e_del
Jul 31 12:20:06 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Deletion of /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e_del complete
Jul 31 12:20:06 user nova-compute[72447]: INFO nova.virt.block_device [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Booting with volume bfb2e0a0-6d39-4cee-babb-47946fde6943 at /dev/vdb
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.utils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[464652ed-e8fd-407f-a056-fcdfd902f524]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-ebb25156-c243-4b81-841c-bd901a61bb86 req-8866bc56-098e-4289-b297-d348ac505abb service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ebb25156-c243-4b81-841c-bd901a61bb86 req-8866bc56-098e-4289-b297-d348ac505abb service nova] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ebb25156-c243-4b81-841c-bd901a61bb86 req-8866bc56-098e-4289-b297-d348ac505abb service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ebb25156-c243-4b81-841c-bd901a61bb86 req-8866bc56-098e-4289-b297-d348ac505abb service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-ebb25156-c243-4b81-841c-bd901a61bb86 req-8866bc56-098e-4289-b297-d348ac505abb service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] No waiting events found dispatching network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:06 user nova-compute[72447]: WARNING nova.compute.manager [req-ebb25156-c243-4b81-841c-bd901a61bb86 req-8866bc56-098e-4289-b297-d348ac505abb service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received unexpected event network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed for instance with vm_state active and task_state rebuild_block_device_mapping.
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efbbe3a-2d99-48fd-9f89-c61d202b0c9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c24cb3-f86f-4abd-8a57-911f80c16700]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[13260625-bfd8-4d55-b186-7947d77c8d19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:20:06 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:20:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4754c6d6-e9c4-43d7-8222-61c7470a0dd8]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG os_brick.utils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:06 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updating existing volume attachment record: ab678693-c69c-4938-a4f9-23672f23f2de {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:20:07 user nova-compute[72447]: DEBUG nova.network.neutron [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating instance_info_cache with network_info: [{"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:20:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Releasing lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:20:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Starting migrate_disk_and_power_off {{(pid=72447) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 31 12:20:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-adf26a02-6fef-4baa-8c14-bc3b32dea23e req-456b8c16-a161-466b-9773-29bdd3312798 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-unplugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-adf26a02-6fef-4baa-8c14-bc3b32dea23e req-456b8c16-a161-466b-9773-29bdd3312798 service nova] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-adf26a02-6fef-4baa-8c14-bc3b32dea23e req-456b8c16-a161-466b-9773-29bdd3312798 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-adf26a02-6fef-4baa-8c14-bc3b32dea23e req-456b8c16-a161-466b-9773-29bdd3312798 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-adf26a02-6fef-4baa-8c14-bc3b32dea23e req-456b8c16-a161-466b-9773-29bdd3312798 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] No waiting events found dispatching network-vif-unplugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:08 user nova-compute[72447]: WARNING nova.compute.manager [req-adf26a02-6fef-4baa-8c14-bc3b32dea23e req-456b8c16-a161-466b-9773-29bdd3312798 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received unexpected event network-vif-unplugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 for instance with vm_state active and task_state resize_migrating.
Jul 31 12:20:08 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Instance destroyed successfully.
Jul 31 12:20:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-89958571',display_name='tempest-ServerActionsTestOtherB-server-89958571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-89958571',id=17,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+f+k0iUUuOhXlHDtikwFngFfrKZWO/pXd3lnR3i6FVV78yfGidAD1wnO5wJJhLxF9aq2IfkjSAFEQM+7NMJo1w081YcYQwauvTLFPqn5c5JoXRC/7+8j1JXyzJ3lUTfg==',key_name='tempest-keypair-1372814901',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:16:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2cdf6c9123e14bf7aa1dc369852d1f06',ramdisk_id='',reservation_id='r-6pk3jb2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1175098759',owner_user_name='tempest-ServerActionsTestOtherB-1175098759-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:20:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='179d710ed6d3412bbfd665d30ccc6451',uuid=92ff498b-1337-47da-aaf1-b5fb9f19e98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-280907744-network", "vif_mac": "fa:16:3e:f8:df:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converting VIF {"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-280907744-network", "vif_mac": "fa:16:3e:f8:df:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_vif [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bf862f6-24, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:08 user nova-compute[72447]: INFO os_vif [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24')
Jul 31 12:20:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSZgmNxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:08 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d343c37d-ab83-4f9a-89a3-c42f45fdf905]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf019811-211b-4488-b6b2-efc0415a8da4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:08 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:08 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:08 user nova-compute[72447]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:08 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:08 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:08 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:08 user nova-compute[72447]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:08 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06682e5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'): ({'sdf'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Removing single pathed devices sdf {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b44c91c-2f95-4e4f-8dfb-f84cf851e13e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffab287-43c1-451c-91f3-9d6c5f26e6b1]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Flushing IO for device /dev/sdf {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e981745-eb59-48b8-9759-f64e47545c19]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bf3246-f190-49b3-8300-7d72533fa1f0]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] SCSI volumes sdf have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a768c0c6-38f7-4a63-bbbf-6c529c43bfbd]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[018fab3f-3d33-4196-9ae6-744dfd34b18a]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260]
Jul 31 12:20:08 user nova-compute[72447]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260] successful.
Jul 31 12:20:08 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[680ae001-06ce-46ab-8886-d8d42a96dfa2]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] <== disconnect_volume: return (270ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:20:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d_resize/disk /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CMD "cp -r /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d_resize/disk /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk" returned: 0 in 0.356s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d_resize/disk.info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk.info {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CMD "cp -r /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d_resize/disk.info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk.info" returned: 0 in 0.044s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-4f552abd-7508-4df5-99e2-0d2d800750fa req-fd2c8c7a-6981-44d1-8cb8-3580c58c55a8 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4f552abd-7508-4df5-99e2-0d2d800750fa req-fd2c8c7a-6981-44d1-8cb8-3580c58c55a8 service nova] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4f552abd-7508-4df5-99e2-0d2d800750fa req-fd2c8c7a-6981-44d1-8cb8-3580c58c55a8 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4f552abd-7508-4df5-99e2-0d2d800750fa req-fd2c8c7a-6981-44d1-8cb8-3580c58c55a8 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-4f552abd-7508-4df5-99e2-0d2d800750fa req-fd2c8c7a-6981-44d1-8cb8-3580c58c55a8 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] No waiting events found dispatching network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:10 user nova-compute[72447]: WARNING nova.compute.manager [req-4f552abd-7508-4df5-99e2-0d2d800750fa req-fd2c8c7a-6981-44d1-8cb8-3580c58c55a8 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received unexpected event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 for instance with vm_state active and task_state resize_migrating.
Jul 31 12:20:10 user nova-compute[72447]: DEBUG nova.network.neutron [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Port 8bf862f6-240f-47c4-bf1a-3cf399024ae2 binding to destination host user is already ACTIVE {{(pid=72447) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 31 12:20:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:20:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquired lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:20:10 user nova-compute[72447]: DEBUG nova.network.neutron [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG nova.network.neutron [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating instance_info_cache with network_info: [{"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Releasing lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG os_brick.utils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7671cdaa-d923-4b58-9602-3b7be7bbc710]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[419d7eca-47a9-4007-9633-241fd92778dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfac00f5-7127-4ad0-b5ff-2c87b8d08606]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3e27e3-a37b-496a-9061-a51a47d13423]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:20:11 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:20:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d18cdd-742d-4f03-a234-28701e82e280]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:20:11 user nova-compute[72447]: DEBUG os_brick.utils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:20:14 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Creating image(s)
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "/opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "/opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "/opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.157s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.150s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk 1073741824" returned: 0 in 0.049s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Cannot resize image /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Ensure instance console log exists: /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Start _get_guest_xml network_info=[{"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'ab678693-c69c-4938-a4f9-23672f23f2de', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsHgfpdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '51310b38-96e0-4d44-ab1e-8d2cc039617e', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfb2e0a0-6d39-4cee-babb-47946fde6943', 'serial': 'bfb2e0a0-6d39-4cee-babb-47946fde6943'}, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:20:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 12:20:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 12:20:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:20:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.objects.instance [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'vcpu_model' on Instance uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsHgfpdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:15 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:15 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:15 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e1a411-588e-4f52-9f50-b0d9cdfac745]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:20:15 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0597b495-86ae-4d91-ad6d-28f99ee5fe57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943] added
Jul 31 12:20:15 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[376adc6b-e0dd-43cb-8b9f-e9c8eb40c798]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2622722e-5d90-49f2-a055-0d8854ad8a15]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VsHgfpdC {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VsHgfpdC" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6fd75c-5bd3-4e5a-931e-e2a444ccd058]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VsHgfpdC'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a039d8f3-055f-4735-953f-c711d2dd14da]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc834d3-12c2-4846-9721-66208d3feb13]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:15 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:15 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:15 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:15 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:15 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:15 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --login" returned: 0 in 0.143s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15647a5-e9f1-409e-b9b5-6ec0f976bc70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260]
Jul 31 12:20:15 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260] successful.
Jul 31 12:20:15 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b75a810-d058-4c70-8d94-06d07937b603]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa3563-73b4-4721-a98c-30f2c4ac3af4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:15 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:15 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:15 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:15 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:15 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:15 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:15 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:15 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6df618-ad9f-4c1b-a7ee-7f1891269a5b]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:15 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsHgfpdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '26137636431333432', 'path': '/dev/sde'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137636431333432', 'path': '/dev/sde'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-615647500',display_name='tempest-ServerActionsTestOtherA-server-1623510083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-615647500',id=16,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWDGihKbMeCNvBwsaW6V6P8R5lowbGENHMAc92pWv6O2vQFLobOnEOvb/OjxIDRXej4CqXst6J0oTtwIiGi8MF4pETlYJBg2aTwKoMBAuzDXV9HfutMu8dkCAol0vT0Q==',key_name='tempest-keypair-1212175094',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:16:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='25afa936e9674cce91443f7bef7409ab',ramdisk_id='',reservation_id='r-9wvn7yz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1904418117',owner_user_name='tempest-ServerActionsTestOtherA-1904418117-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:20:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfd7290fb1a45b7a27cfb5faa08cc5d',uuid=51310b38-96e0-4d44-ab1e-8d2cc039617e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converting VIF {"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:20:16 user nova-compute[72447]:   <uuid>51310b38-96e0-4d44-ab1e-8d2cc039617e</uuid>
Jul 31 12:20:16 user nova-compute[72447]:   <name>instance-00000010</name>
Jul 31 12:20:16 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:20:16 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:20:16 user nova-compute[72447]:   <metadata>
Jul 31 12:20:16 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:20:16 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:20:16 user nova-compute[72447]:       <nova:name>tempest-ServerActionsTestOtherA-server-1623510083</nova:name>
Jul 31 12:20:16 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:20:14</nova:creationTime>
Jul 31 12:20:16 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:20:16 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:20:16 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:20:16 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:20:16 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:20:16 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:20:16 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:20:16 user nova-compute[72447]:       <nova:owner>
Jul 31 12:20:16 user nova-compute[72447]:         <nova:user uuid="0bfd7290fb1a45b7a27cfb5faa08cc5d">tempest-ServerActionsTestOtherA-1904418117-project-member</nova:user>
Jul 31 12:20:16 user nova-compute[72447]:         <nova:project uuid="25afa936e9674cce91443f7bef7409ab">tempest-ServerActionsTestOtherA-1904418117</nova:project>
Jul 31 12:20:16 user nova-compute[72447]:       </nova:owner>
Jul 31 12:20:16 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:20:16 user nova-compute[72447]:       <nova:ports>
Jul 31 12:20:16 user nova-compute[72447]:         <nova:port uuid="fe243daf-4d07-48dd-84c9-1252c65085ed">
Jul 31 12:20:16 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 12:20:16 user nova-compute[72447]:         </nova:port>
Jul 31 12:20:16 user nova-compute[72447]:       </nova:ports>
Jul 31 12:20:16 user nova-compute[72447]:     </nova:instance>
Jul 31 12:20:16 user nova-compute[72447]:   </metadata>
Jul 31 12:20:16 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:20:16 user nova-compute[72447]:     <system>
Jul 31 12:20:16 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:20:16 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:20:16 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:20:16 user nova-compute[72447]:       <entry name="serial">51310b38-96e0-4d44-ab1e-8d2cc039617e</entry>
Jul 31 12:20:16 user nova-compute[72447]:       <entry name="uuid">51310b38-96e0-4d44-ab1e-8d2cc039617e</entry>
Jul 31 12:20:16 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:20:16 user nova-compute[72447]:     </system>
Jul 31 12:20:16 user nova-compute[72447]:   </sysinfo>
Jul 31 12:20:16 user nova-compute[72447]:   <os>
Jul 31 12:20:16 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:20:16 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:20:16 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:20:16 user nova-compute[72447]:   </os>
Jul 31 12:20:16 user nova-compute[72447]:   <features>
Jul 31 12:20:16 user nova-compute[72447]:     <acpi/>
Jul 31 12:20:16 user nova-compute[72447]:     <apic/>
Jul 31 12:20:16 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:20:16 user nova-compute[72447]:   </features>
Jul 31 12:20:16 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:20:16 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:20:16 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:20:16 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:20:16 user nova-compute[72447]:   </clock>
Jul 31 12:20:16 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:20:16 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:20:16 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:20:16 user nova-compute[72447]:   </cpu>
Jul 31 12:20:16 user nova-compute[72447]:   <devices>
Jul 31 12:20:16 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:20:16 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:20:16 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk"/>
Jul 31 12:20:16 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:20:16 user nova-compute[72447]:     </disk>
Jul 31 12:20:16 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:20:16 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:20:16 user nova-compute[72447]:       <source dev="/dev/sde"/>
Jul 31 12:20:16 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:20:16 user nova-compute[72447]:       <serial>bfb2e0a0-6d39-4cee-babb-47946fde6943</serial>
Jul 31 12:20:16 user nova-compute[72447]:     </disk>
Jul 31 12:20:16 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:20:16 user nova-compute[72447]:       <mac address="fa:16:3e:8c:ca:e2"/>
Jul 31 12:20:16 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:20:16 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:20:16 user nova-compute[72447]:       <target dev="tapfe243daf-4d"/>
Jul 31 12:20:16 user nova-compute[72447]:     </interface>
Jul 31 12:20:16 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:20:16 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/console.log" append="off"/>
Jul 31 12:20:16 user nova-compute[72447]:     </serial>
Jul 31 12:20:16 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:20:16 user nova-compute[72447]:     <video>
Jul 31 12:20:16 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:20:16 user nova-compute[72447]:     </video>
Jul 31 12:20:16 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:20:16 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:20:16 user nova-compute[72447]:     </rng>
Jul 31 12:20:16 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:20:16 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:20:16 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:20:16 user nova-compute[72447]:     </memballoon>
Jul 31 12:20:16 user nova-compute[72447]:   </devices>
Jul 31 12:20:16 user nova-compute[72447]: </domain>
Jul 31 12:20:16 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-615647500',display_name='tempest-ServerActionsTestOtherA-server-1623510083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-615647500',id=16,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWDGihKbMeCNvBwsaW6V6P8R5lowbGENHMAc92pWv6O2vQFLobOnEOvb/OjxIDRXej4CqXst6J0oTtwIiGi8MF4pETlYJBg2aTwKoMBAuzDXV9HfutMu8dkCAol0vT0Q==',key_name='tempest-keypair-1212175094',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:16:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='25afa936e9674cce91443f7bef7409ab',ramdisk_id='',reservation_id='r-9wvn7yz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1904418117',owner_user_name='tempest-ServerActionsTestOtherA-1904418117-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:20:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfd7290fb1a45b7a27cfb5faa08cc5d',uuid=51310b38-96e0-4d44-ab1e-8d2cc039617e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converting VIF {"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG os_vif [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe243daf-4d, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe243daf-4d, col_values=(('external_ids', {'iface-id': 'fe243daf-4d07-48dd-84c9-1252c65085ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:ca:e2', 'vm-uuid': '51310b38-96e0-4d44-ab1e-8d2cc039617e'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:16 user nova-compute[72447]: INFO os_vif [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d')
Jul 31 12:20:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:20:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] No VIF found with MAC fa:16:3e:8c:ca:e2, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:20:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG nova.compute.manager [req-9e653672-4724-4446-b2d9-8254cc7e79c9 req-f60ae7ac-0430-4eb4-b3dd-2801a247e7dc service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9e653672-4724-4446-b2d9-8254cc7e79c9 req-f60ae7ac-0430-4eb4-b3dd-2801a247e7dc service nova] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9e653672-4724-4446-b2d9-8254cc7e79c9 req-f60ae7ac-0430-4eb4-b3dd-2801a247e7dc service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9e653672-4724-4446-b2d9-8254cc7e79c9 req-f60ae7ac-0430-4eb4-b3dd-2801a247e7dc service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG nova.compute.manager [req-9e653672-4724-4446-b2d9-8254cc7e79c9 req-f60ae7ac-0430-4eb4-b3dd-2801a247e7dc service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] No waiting events found dispatching network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:18 user nova-compute[72447]: WARNING nova.compute.manager [req-9e653672-4724-4446-b2d9-8254cc7e79c9 req-f60ae7ac-0430-4eb4-b3dd-2801a247e7dc service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received unexpected event network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed for instance with vm_state active and task_state rebuild_spawning.
Jul 31 12:20:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG nova.compute.manager [req-41812e59-27bf-4ce3-83d5-83d234d43e8f req-c3f08e7e-2b37-42c1-a244-3233ac94f456 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-changed-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG nova.compute.manager [req-41812e59-27bf-4ce3-83d5-83d234d43e8f req-c3f08e7e-2b37-42c1-a244-3233ac94f456 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Refreshing instance network info cache due to event network-changed-fcf8adb7-881f-403d-bc7b-27a782db1dd5. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-41812e59-27bf-4ce3-83d5-83d234d43e8f req-c3f08e7e-2b37-42c1-a244-3233ac94f456 service nova] Acquiring lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-41812e59-27bf-4ce3-83d5-83d234d43e8f req-c3f08e7e-2b37-42c1-a244-3233ac94f456 service nova] Acquired lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:20:18 user nova-compute[72447]: DEBUG nova.network.neutron [req-41812e59-27bf-4ce3-83d5-83d234d43e8f req-c3f08e7e-2b37-42c1-a244-3233ac94f456 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Refreshing network info cache for port fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Starting finish_migration {{(pid=72447) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Instance directory exists: not creating {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 12:20:19 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Creating image(s)
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.objects.instance [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'trusted_certs' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.network.neutron [req-41812e59-27bf-4ce3-83d5-83d234d43e8f req-c3f08e7e-2b37-42c1-a244-3233ac94f456 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Updated VIF entry in instance network info cache for port fcf8adb7-881f-403d-bc7b-27a782db1dd5. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.network.neutron [req-41812e59-27bf-4ce3-83d5-83d234d43e8f req-c3f08e7e-2b37-42c1-a244-3233ac94f456 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Updating instance_info_cache with network_info: [{"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-41812e59-27bf-4ce3-83d5-83d234d43e8f req-c3f08e7e-2b37-42c1-a244-3233ac94f456 service nova] Releasing lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk. size=21474836480 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk 21474836480 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk 21474836480" returned: 0 in 0.061s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Ensure instance console log exists: /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Start _get_guest_xml network_info=[{"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-280907744-network", "vif_mac": "fa:16:3e:f8:df:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'fb1b485b-7b80-4f8d-a04d-b3f86a0c7a5b', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSZgmNxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '92ff498b-1337-47da-aaf1-b5fb9f19e98d', 'attached_at': '2023-07-31T12:20:19.000000', 'detached_at': '', 'volume_id': 'ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc', 'serial': 'ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'}, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:20:19 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:20:19 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.objects.instance [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'vcpu_model' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSZgmNxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:19 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:19 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:19 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba05f119-aca7-42cf-ab44-26db21e8699f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:20:19 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b683b571-c1db-47ce-a71f-65a3ac5f7de2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc] added
Jul 31 12:20:19 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b103dbca-5246-4821-bda0-9943ad1ab96d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3f4189-eb83-46d6-92b2-85d9443526b1]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSZgmNxe {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSZgmNxe" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[777a1771-0699-45ca-b61c-6db3819c8989]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kSZgmNxe'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0cda6c-6549-4229-8073-17a7a69b4214]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa87b1c-2f65-43d8-927b-4dd6e45430d8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:20 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:20 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7034e20a-9a26-4b77-80fd-82499a1fb138]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260]
Jul 31 12:20:20 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260] successful.
Jul 31 12:20:20 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 51310b38-96e0-4d44-ab1e-8d2cc039617e due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806020.139506, 51310b38-96e0-4d44-ab1e-8d2cc039617e => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:20:20 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] VM Resumed (Lifecycle Event)
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabdd4d0-dd96-4f83-950c-e3d872954cda]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:20 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Instance spawned successfully.
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db3c6ee-c7ab-4a87-b967-17ff0f9a2ec0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:20 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:20 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:20 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:20 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806020.1414838, 51310b38-96e0-4d44-ab1e-8d2cc039617e => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:20:20 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] VM Started (Lifecycle Event)
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f41f3fe-41fc-457a-b35f-d5ec85a8c8a3]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSZgmNxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.compute.manager [req-0948a65e-c96b-4513-aada-c143e9df6455 req-b4b18d8b-32b3-4f9d-8af9-757c3324eb53 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0948a65e-c96b-4513-aada-c143e9df6455 req-b4b18d8b-32b3-4f9d-8af9-757c3324eb53 service nova] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0948a65e-c96b-4513-aada-c143e9df6455 req-b4b18d8b-32b3-4f9d-8af9-757c3324eb53 service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0948a65e-c96b-4513-aada-c143e9df6455 req-b4b18d8b-32b3-4f9d-8af9-757c3324eb53 service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.compute.manager [req-0948a65e-c96b-4513-aada-c143e9df6455 req-b4b18d8b-32b3-4f9d-8af9-757c3324eb53 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] No waiting events found dispatching network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:20 user nova-compute[72447]: WARNING nova.compute.manager [req-0948a65e-c96b-4513-aada-c143e9df6455 req-b4b18d8b-32b3-4f9d-8af9-757c3324eb53 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received unexpected event network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed for instance with vm_state active and task_state rebuild_spawning.
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:20:20 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG nova.objects.instance [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72447) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 12:20:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2e1667cf-08ed-4f26-b805-a227ddafd8d5 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.106s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23561626661346564', 'path': '/dev/sdf'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561626661346564', 'path': '/dev/sdf'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-89958571',display_name='tempest-ServerActionsTestOtherB-server-89958571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-89958571',id=17,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+f+k0iUUuOhXlHDtikwFngFfrKZWO/pXd3lnR3i6FVV78yfGidAD1wnO5wJJhLxF9aq2IfkjSAFEQM+7NMJo1w081YcYQwauvTLFPqn5c5JoXRC/7+8j1JXyzJ3lUTfg==',key_name='tempest-keypair-1372814901',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:16:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2cdf6c9123e14bf7aa1dc369852d1f06',ramdisk_id='',reservation_id='r-6pk3jb2b',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1175098759',owner_user_name='tempest-ServerActionsTestOtherB-1175098759-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='179d710ed6d3412bbfd665d30ccc6451',uuid=92ff498b-1337-47da-aaf1-b5fb9f19e98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-280907744-network", "vif_mac": "fa:16:3e:f8:df:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converting VIF {"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-280907744-network", "vif_mac": "fa:16:3e:f8:df:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:20:21 user nova-compute[72447]:   <uuid>92ff498b-1337-47da-aaf1-b5fb9f19e98d</uuid>
Jul 31 12:20:21 user nova-compute[72447]:   <name>instance-00000011</name>
Jul 31 12:20:21 user nova-compute[72447]:   <memory>2097152</memory>
Jul 31 12:20:21 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:20:21 user nova-compute[72447]:   <metadata>
Jul 31 12:20:21 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:20:21 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:20:21 user nova-compute[72447]:       <nova:name>tempest-ServerActionsTestOtherB-server-89958571</nova:name>
Jul 31 12:20:21 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:20:19</nova:creationTime>
Jul 31 12:20:21 user nova-compute[72447]:       <nova:flavor name="m1.small">
Jul 31 12:20:21 user nova-compute[72447]:         <nova:memory>2048</nova:memory>
Jul 31 12:20:21 user nova-compute[72447]:         <nova:disk>20</nova:disk>
Jul 31 12:20:21 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:20:21 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:20:21 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:20:21 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:20:21 user nova-compute[72447]:       <nova:owner>
Jul 31 12:20:21 user nova-compute[72447]:         <nova:user uuid="179d710ed6d3412bbfd665d30ccc6451">tempest-ServerActionsTestOtherB-1175098759-project-member</nova:user>
Jul 31 12:20:21 user nova-compute[72447]:         <nova:project uuid="2cdf6c9123e14bf7aa1dc369852d1f06">tempest-ServerActionsTestOtherB-1175098759</nova:project>
Jul 31 12:20:21 user nova-compute[72447]:       </nova:owner>
Jul 31 12:20:21 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:20:21 user nova-compute[72447]:       <nova:ports>
Jul 31 12:20:21 user nova-compute[72447]:         <nova:port uuid="8bf862f6-240f-47c4-bf1a-3cf399024ae2">
Jul 31 12:20:21 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 12:20:21 user nova-compute[72447]:         </nova:port>
Jul 31 12:20:21 user nova-compute[72447]:       </nova:ports>
Jul 31 12:20:21 user nova-compute[72447]:     </nova:instance>
Jul 31 12:20:21 user nova-compute[72447]:   </metadata>
Jul 31 12:20:21 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:20:21 user nova-compute[72447]:     <system>
Jul 31 12:20:21 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:20:21 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:20:21 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:20:21 user nova-compute[72447]:       <entry name="serial">92ff498b-1337-47da-aaf1-b5fb9f19e98d</entry>
Jul 31 12:20:21 user nova-compute[72447]:       <entry name="uuid">92ff498b-1337-47da-aaf1-b5fb9f19e98d</entry>
Jul 31 12:20:21 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:20:21 user nova-compute[72447]:     </system>
Jul 31 12:20:21 user nova-compute[72447]:   </sysinfo>
Jul 31 12:20:21 user nova-compute[72447]:   <os>
Jul 31 12:20:21 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:20:21 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:20:21 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:20:21 user nova-compute[72447]:   </os>
Jul 31 12:20:21 user nova-compute[72447]:   <features>
Jul 31 12:20:21 user nova-compute[72447]:     <acpi/>
Jul 31 12:20:21 user nova-compute[72447]:     <apic/>
Jul 31 12:20:21 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:20:21 user nova-compute[72447]:   </features>
Jul 31 12:20:21 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:20:21 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:20:21 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:20:21 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:20:21 user nova-compute[72447]:   </clock>
Jul 31 12:20:21 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:20:21 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:20:21 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:20:21 user nova-compute[72447]:   </cpu>
Jul 31 12:20:21 user nova-compute[72447]:   <devices>
Jul 31 12:20:21 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:20:21 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:20:21 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk"/>
Jul 31 12:20:21 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:20:21 user nova-compute[72447]:     </disk>
Jul 31 12:20:21 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:20:21 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:20:21 user nova-compute[72447]:       <source dev="/dev/sdf"/>
Jul 31 12:20:21 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:20:21 user nova-compute[72447]:       <serial>ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc</serial>
Jul 31 12:20:21 user nova-compute[72447]:     </disk>
Jul 31 12:20:21 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:20:21 user nova-compute[72447]:       <mac address="fa:16:3e:f8:df:6b"/>
Jul 31 12:20:21 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:20:21 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:20:21 user nova-compute[72447]:       <target dev="tap8bf862f6-24"/>
Jul 31 12:20:21 user nova-compute[72447]:     </interface>
Jul 31 12:20:21 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:20:21 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/console.log" append="off"/>
Jul 31 12:20:21 user nova-compute[72447]:     </serial>
Jul 31 12:20:21 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:20:21 user nova-compute[72447]:     <video>
Jul 31 12:20:21 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:20:21 user nova-compute[72447]:     </video>
Jul 31 12:20:21 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:20:21 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:20:21 user nova-compute[72447]:     </rng>
Jul 31 12:20:21 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:20:21 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:20:21 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:20:21 user nova-compute[72447]:     </memballoon>
Jul 31 12:20:21 user nova-compute[72447]:   </devices>
Jul 31 12:20:21 user nova-compute[72447]: </domain>
Jul 31 12:20:21 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-89958571',display_name='tempest-ServerActionsTestOtherB-server-89958571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-89958571',id=17,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+f+k0iUUuOhXlHDtikwFngFfrKZWO/pXd3lnR3i6FVV78yfGidAD1wnO5wJJhLxF9aq2IfkjSAFEQM+7NMJo1w081YcYQwauvTLFPqn5c5JoXRC/7+8j1JXyzJ3lUTfg==',key_name='tempest-keypair-1372814901',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:16:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2cdf6c9123e14bf7aa1dc369852d1f06',ramdisk_id='',reservation_id='r-6pk3jb2b',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1175098759',owner_user_name='tempest-ServerActionsTestOtherB-1175098759-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='179d710ed6d3412bbfd665d30ccc6451',uuid=92ff498b-1337-47da-aaf1-b5fb9f19e98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-280907744-network", "vif_mac": "fa:16:3e:f8:df:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converting VIF {"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-280907744-network", "vif_mac": "fa:16:3e:f8:df:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG os_vif [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bf862f6-24, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8bf862f6-24, col_values=(('external_ids', {'iface-id': '8bf862f6-240f-47c4-bf1a-3cf399024ae2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:df:6b', 'vm-uuid': '92ff498b-1337-47da-aaf1-b5fb9f19e98d'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:21 user nova-compute[72447]: INFO os_vif [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24')
Jul 31 12:20:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:20:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] No VIF found with MAC fa:16:3e:f8:df:6b, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:20:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-e7866e86-43ab-44cf-a8ba-67a1febf5d8a req-d3856f79-b4af-47d9-9c37-853bf0d46e2f service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e7866e86-43ab-44cf-a8ba-67a1febf5d8a req-d3856f79-b4af-47d9-9c37-853bf0d46e2f service nova] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e7866e86-43ab-44cf-a8ba-67a1febf5d8a req-d3856f79-b4af-47d9-9c37-853bf0d46e2f service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e7866e86-43ab-44cf-a8ba-67a1febf5d8a req-d3856f79-b4af-47d9-9c37-853bf0d46e2f service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-e7866e86-43ab-44cf-a8ba-67a1febf5d8a req-d3856f79-b4af-47d9-9c37-853bf0d46e2f service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] No waiting events found dispatching network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:23 user nova-compute[72447]: WARNING nova.compute.manager [req-e7866e86-43ab-44cf-a8ba-67a1febf5d8a req-d3856f79-b4af-47d9-9c37-853bf0d46e2f service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received unexpected event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 for instance with vm_state active and task_state resize_finish.
Jul 31 12:20:23 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806008.4636557, 92ff498b-1337-47da-aaf1-b5fb9f19e98d => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:20:23 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] VM Stopped (Lifecycle Event)
Jul 31 12:20:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:23 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9f096b87-a965-49e7-83ad-6f3ee5265cc5 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "87220d5b-df7b-4664-a5e8-088157130701" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:23 user nova-compute[72447]: INFO nova.compute.manager [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Shelving
Jul 31 12:20:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:24 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Instance destroyed successfully.
Jul 31 12:20:24 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Beginning cold snapshot process
Jul 31 12:20:24 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:20:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk /opt/stack/data/nova/instances/snapshots/tmp80fszjd_/68a8250f90ef4862a1486db536913787 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] No waiting events found dispatching network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:25 user nova-compute[72447]: WARNING nova.compute.manager [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received unexpected event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 for instance with vm_state active and task_state resize_finish.
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-vif-unplugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] No waiting events found dispatching network-vif-unplugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:25 user nova-compute[72447]: WARNING nova.compute.manager [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received unexpected event network-vif-unplugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] No waiting events found dispatching network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:25 user nova-compute[72447]: WARNING nova.compute.manager [req-90848721-76bd-4221-a543-5d49508367e6 req-bedd7c8a-62c5-4b7e-9054-fdc8a282c648 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received unexpected event network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806025.3009307, 92ff498b-1337-47da-aaf1-b5fb9f19e98d => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:20:25 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] VM Resumed (Lifecycle Event)
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:20:25 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Instance running successfully.
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Failed to set time: agent not configured {{(pid=72447) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-89b91422-a111-45ac-bdf1-dd19e2b9995e tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] finish_migration finished successfully. {{(pid=72447) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:20:25 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806025.3022919, 92ff498b-1337-47da-aaf1-b5fb9f19e98d => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:20:25 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] VM Started (Lifecycle Event)
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:20:25 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 12:20:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk /opt/stack/data/nova/instances/snapshots/tmp80fszjd_/68a8250f90ef4862a1486db536913787" returned: 0 in 0.811s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:25 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Snapshot extracted, beginning image upload
Jul 31 12:20:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:28 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Snapshot image upload complete
Jul 31 12:20:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:28 user nova-compute[72447]: INFO nova.compute.manager [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Shelve offloading
Jul 31 12:20:28 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Instance destroyed successfully.
Jul 31 12:20:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:20:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquired lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:20:28 user nova-compute[72447]: DEBUG nova.network.neutron [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:20:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-e5631ffe-9d11-4eef-9395-efb453a44c89 req-1da10ebb-0a2e-4fde-8244-93bc2a4f2e8e service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Received event network-changed-cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-e5631ffe-9d11-4eef-9395-efb453a44c89 req-1da10ebb-0a2e-4fde-8244-93bc2a4f2e8e service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Refreshing instance network info cache due to event network-changed-cd04ddb5-4657-4e58-b422-7431d46e9ab5. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:20:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e5631ffe-9d11-4eef-9395-efb453a44c89 req-1da10ebb-0a2e-4fde-8244-93bc2a4f2e8e service nova] Acquiring lock "refresh_cache-b291ba57-9fdb-48f2-ac0c-45a108dda3b1" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:20:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e5631ffe-9d11-4eef-9395-efb453a44c89 req-1da10ebb-0a2e-4fde-8244-93bc2a4f2e8e service nova] Acquired lock "refresh_cache-b291ba57-9fdb-48f2-ac0c-45a108dda3b1" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:20:28 user nova-compute[72447]: DEBUG nova.network.neutron [req-e5631ffe-9d11-4eef-9395-efb453a44c89 req-1da10ebb-0a2e-4fde-8244-93bc2a4f2e8e service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Refreshing network info cache for port cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:20:29 user nova-compute[72447]: DEBUG nova.network.neutron [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Updating instance_info_cache with network_info: [{"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:20:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Releasing lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:20:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:29 user nova-compute[72447]: DEBUG nova.network.neutron [req-e5631ffe-9d11-4eef-9395-efb453a44c89 req-1da10ebb-0a2e-4fde-8244-93bc2a4f2e8e service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Updated VIF entry in instance network info cache for port cd04ddb5-4657-4e58-b422-7431d46e9ab5. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:20:29 user nova-compute[72447]: DEBUG nova.network.neutron [req-e5631ffe-9d11-4eef-9395-efb453a44c89 req-1da10ebb-0a2e-4fde-8244-93bc2a4f2e8e service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Updating instance_info_cache with network_info: [{"id": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "address": "fa:16:3e:59:1a:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd04ddb5-46", "ovs_interfaceid": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:20:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e5631ffe-9d11-4eef-9395-efb453a44c89 req-1da10ebb-0a2e-4fde-8244-93bc2a4f2e8e service nova] Releasing lock "refresh_cache-b291ba57-9fdb-48f2-ac0c-45a108dda3b1" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:20:30 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Instance destroyed successfully.
Jul 31 12:20:30 user nova-compute[72447]: DEBUG nova.objects.instance [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'resources' on Instance uuid 87220d5b-df7b-4664-a5e8-088157130701 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1809185140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1809185140',id=21,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsjkp3AZodxtBxsAt/VOiQNsOssof0791bnDw6kXo1qalLZuixWZDfUdE+7iSVjIKO/vnIxlJCZuB5Blyb4/Bx18cIDvjWLFw43QhuekDLT5oFcsVtn2OfEKnZpzCXqjA==',key_name='tempest-keypair-1672108798',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:18:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8b8dd0d543cb4786afc39e88f440e538',ramdisk_id='',reservation_id='r-fx3n0x08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1971436108',owner_user_name='tempest-AttachVolumeShelveTestJSON-1971436108-project-member',shelved_at='2023-07-31T12:20:28.271236',shelved_host='user',shelved_image_id='880f1411-5daf-4055-9496-7f58698c558e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:20:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc465160a3a94498ab1aa3aa44280b12',uuid=87220d5b-df7b-4664-a5e8-088157130701,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converting VIF {"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG os_vif [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcf8adb7-88, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:20:30 user nova-compute[72447]: INFO os_vif [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88')
Jul 31 12:20:30 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Deleting instance files /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701_del
Jul 31 12:20:30 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Deletion of /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701_del complete
Jul 31 12:20:30 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Deleted allocations for instance 87220d5b-df7b-4664-a5e8-088157130701
Jul 31 12:20:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG nova.objects.instance [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'numa_topology' on Instance uuid 87220d5b-df7b-4664-a5e8-088157130701 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97d5a5db-8b0b-4c2d-9ca7-3c6acfd0097a tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "87220d5b-df7b-4664-a5e8-088157130701" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.087s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:32 user nova-compute[72447]: DEBUG nova.objects.instance [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lazy-loading 'flavor' on Instance uuid b291ba57-9fdb-48f2-ac0c-45a108dda3b1 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:32 user nova-compute[72447]: INFO nova.compute.manager [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Attaching volume 50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 to /dev/vdb
Jul 31 12:20:32 user nova-compute[72447]: DEBUG os_brick.utils [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1824a4-c962-43b2-b600-6369c24d463f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36b587e-7636-422d-a4d1-7bab02262655]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d417563b-98a9-4de9-a74b-94ff52919b6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88bfc9a-9231-4234-8687-24932be57835]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:20:33 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:20:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d964e287-6d4e-44d0-9759-c76d31b43ff9]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG os_brick.utils [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:33 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Updating existing volume attachment record: fb8caad0-283a-44ed-8e6b-26c46248e503 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:20:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:36 user nova-compute[72447]: INFO nova.compute.manager [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Rescuing
Jul 31 12:20:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:20:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquired lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:20:36 user nova-compute[72447]: DEBUG nova.network.neutron [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:20:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-f10f66ce-2a8b-4f67-be64-d3cb7ad49662 req-8f0f0fe6-513f-4284-93ea-70694d14b94b service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-changed-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-f10f66ce-2a8b-4f67-be64-d3cb7ad49662 req-8f0f0fe6-513f-4284-93ea-70694d14b94b service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Refreshing instance network info cache due to event network-changed-c491e329-e20e-47e6-893a-7643968aba7e. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:20:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f10f66ce-2a8b-4f67-be64-d3cb7ad49662 req-8f0f0fe6-513f-4284-93ea-70694d14b94b service nova] Acquiring lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:20:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f10f66ce-2a8b-4f67-be64-d3cb7ad49662 req-8f0f0fe6-513f-4284-93ea-70694d14b94b service nova] Acquired lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:20:37 user nova-compute[72447]: DEBUG nova.network.neutron [req-f10f66ce-2a8b-4f67-be64-d3cb7ad49662 req-8f0f0fe6-513f-4284-93ea-70694d14b94b service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Refreshing network info cache for port c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:20:37 user nova-compute[72447]: DEBUG nova.network.neutron [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Updating instance_info_cache with network_info: [{"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:20:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Releasing lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:20:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG nova.network.neutron [req-f10f66ce-2a8b-4f67-be64-d3cb7ad49662 req-8f0f0fe6-513f-4284-93ea-70694d14b94b service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updated VIF entry in instance network info cache for port c491e329-e20e-47e6-893a-7643968aba7e. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG nova.network.neutron [req-f10f66ce-2a8b-4f67-be64-d3cb7ad49662 req-8f0f0fe6-513f-4284-93ea-70694d14b94b service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updating instance_info_cache with network_info: [{"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f10f66ce-2a8b-4f67-be64-d3cb7ad49662 req-8f0f0fe6-513f-4284-93ea-70694d14b94b service nova] Releasing lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-123e9370-68cd-4d1d-9093-49ba044044ce req-25339781-3161-4dcb-8fdf-8206d8d248e0 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-unplugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-123e9370-68cd-4d1d-9093-49ba044044ce req-25339781-3161-4dcb-8fdf-8206d8d248e0 service nova] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-123e9370-68cd-4d1d-9093-49ba044044ce req-25339781-3161-4dcb-8fdf-8206d8d248e0 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-123e9370-68cd-4d1d-9093-49ba044044ce req-25339781-3161-4dcb-8fdf-8206d8d248e0 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-123e9370-68cd-4d1d-9093-49ba044044ce req-25339781-3161-4dcb-8fdf-8206d8d248e0 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] No waiting events found dispatching network-vif-unplugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:38 user nova-compute[72447]: WARNING nova.compute.manager [req-123e9370-68cd-4d1d-9093-49ba044044ce req-25339781-3161-4dcb-8fdf-8206d8d248e0 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received unexpected event network-vif-unplugged-7e1213ee-4076-42af-a8cb-d3825739d314 for instance with vm_state active and task_state rescuing.
Jul 31 12:20:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-52324206-6f35-4a27-8db0-742354c6beef req-7f4df24d-2031-4331-97e9-2bf64783aba3 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-changed-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-52324206-6f35-4a27-8db0-742354c6beef req-7f4df24d-2031-4331-97e9-2bf64783aba3 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Refreshing instance network info cache due to event network-changed-c491e329-e20e-47e6-893a-7643968aba7e. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-52324206-6f35-4a27-8db0-742354c6beef req-7f4df24d-2031-4331-97e9-2bf64783aba3 service nova] Acquiring lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-52324206-6f35-4a27-8db0-742354c6beef req-7f4df24d-2031-4331-97e9-2bf64783aba3 service nova] Acquired lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG nova.network.neutron [req-52324206-6f35-4a27-8db0-742354c6beef req-7f4df24d-2031-4331-97e9-2bf64783aba3 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Refreshing network info cache for port c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Instance destroyed successfully.
Jul 31 12:20:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Attempting a stable device rescue
Jul 31 12:20:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72447) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Instance directory exists: not creating {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 12:20:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Creating image(s)
Jul 31 12:20:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "/opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "/opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG nova.objects.instance [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0dbd2353-0521-4e92-8722-6151bfb40924 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "711ccdba28117229f27dcaf938dd17031690f038" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "711ccdba28117229f27dcaf938dd17031690f038" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038.part --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:39 user nova-compute[72447]: INFO nova.compute.manager [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Detaching volume 9b7d15ea-d519-4598-a858-d87931572ea3
Jul 31 12:20:39 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806024.727734, 87220d5b-df7b-4664-a5e8-088157130701 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:20:39 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 87220d5b-df7b-4664-a5e8-088157130701] VM Stopped (Lifecycle Event)
Jul 31 12:20:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038.part --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG nova.virt.images [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] a5bc58ce-3e2b-4f5e-835f-cf51d7c28aa6 was qcow2, converting to raw {{(pid=72447) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038.part /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038.converted {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:39 user nova-compute[72447]: INFO nova.virt.block_device [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Attempting to driver detach volume 9b7d15ea-d519-4598-a858-d87931572ea3 from mountpoint /dev/vdb
Jul 31 12:20:39 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5a3a6cb4-6e47-4322-9c43-4d2a3fd269da None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Attempting to detach device vdb from instance e75d2046-19d7-46b8-9c63-5af205c87c08 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:20:39 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:20:39 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:20:39 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:20:39 user nova-compute[72447]:   <serial>9b7d15ea-d519-4598-a858-d87931572ea3</serial>
Jul 31 12:20:39 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 12:20:39 user nova-compute[72447]: </disk>
Jul 31 12:20:39 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:20:39 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Successfully detached device vdb from instance e75d2046-19d7-46b8-9c63-5af205c87c08 from the persistent domain config.
Jul 31 12:20:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e75d2046-19d7-46b8-9c63-5af205c87c08 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:20:39 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:20:39 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:20:39 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:20:39 user nova-compute[72447]:   <serial>9b7d15ea-d519-4598-a858-d87931572ea3</serial>
Jul 31 12:20:39 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 12:20:39 user nova-compute[72447]: </disk>
Jul 31 12:20:39 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038.part /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038.converted" returned: 0 in 0.184s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038.converted --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG nova.network.neutron [req-52324206-6f35-4a27-8db0-742354c6beef req-7f4df24d-2031-4331-97e9-2bf64783aba3 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updated VIF entry in instance network info cache for port c491e329-e20e-47e6-893a-7643968aba7e. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:20:39 user nova-compute[72447]: DEBUG nova.network.neutron [req-52324206-6f35-4a27-8db0-742354c6beef req-7f4df24d-2031-4331-97e9-2bf64783aba3 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updating instance_info_cache with network_info: [{"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-52324206-6f35-4a27-8db0-742354c6beef req-7f4df24d-2031-4331-97e9-2bf64783aba3 service nova] Releasing lock "refresh_cache-e75d2046-19d7-46b8-9c63-5af205c87c08" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "711ccdba28117229f27dcaf938dd17031690f038" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.311s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "711ccdba28117229f27dcaf938dd17031690f038" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "711ccdba28117229f27dcaf938dd17031690f038" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038 --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038 --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038,backing_fmt=raw /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.rescue {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038,backing_fmt=raw /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.rescue" returned: 0 in 0.049s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "711ccdba28117229f27dcaf938dd17031690f038" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.objects.instance [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'migration_context' on Instance uuid 0dbd2353-0521-4e92-8722-6151bfb40924 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806040.287398, e75d2046-19d7-46b8-9c63-5af205c87c08 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.compute.manager [req-56145a0d-1594-43c7-9941-20f8f6c438de req-7f35e91d-c17a-47b0-be0d-e788bcf74d8b service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-56145a0d-1594-43c7-9941-20f8f6c438de req-7f35e91d-c17a-47b0-be0d-e788bcf74d8b service nova] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-56145a0d-1594-43c7-9941-20f8f6c438de req-7f35e91d-c17a-47b0-be0d-e788bcf74d8b service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-56145a0d-1594-43c7-9941-20f8f6c438de req-7f35e91d-c17a-47b0-be0d-e788bcf74d8b service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.compute.manager [req-56145a0d-1594-43c7-9941-20f8f6c438de req-7f35e91d-c17a-47b0-be0d-e788bcf74d8b service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] No waiting events found dispatching network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:40 user nova-compute[72447]: WARNING nova.compute.manager [req-56145a0d-1594-43c7-9941-20f8f6c438de req-7f35e91d-c17a-47b0-be0d-e788bcf74d8b service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received unexpected event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 for instance with vm_state active and task_state rescuing.
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Start _get_guest_xml network_info=[{"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "vif_mac": "fa:16:3e:81:a7:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a5bc58ce-3e2b-4f5e-835f-cf51d7c28aa6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '9a371cb6-0589-4224-b6f3-7cc7a8ebaeb4', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbGehHtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '0dbd2353-0521-4e92-8722-6151bfb40924', 'attached_at': '', 'detached_at': '', 'volume_id': '5c390fca-f26f-4a6f-8340-a3037945e466', 'serial': '5c390fca-f26f-4a6f-8340-a3037945e466'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.objects.instance [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'resources' on Instance uuid 0dbd2353-0521-4e92-8722-6151bfb40924 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:20:40 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Successfully detached device vdb from instance e75d2046-19d7-46b8-9c63-5af205c87c08 from the live domain config.
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.objects.instance [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'numa_topology' on Instance uuid 0dbd2353-0521-4e92-8722-6151bfb40924 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkgrlMum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:40 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:20:40 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.objects.instance [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0dbd2353-0521-4e92-8722-6151bfb40924 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d376cc44-1005-4a30-9f05-53099c716eba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbGehHtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:40 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[809168f0-f9e2-4c47-a04d-b3cab2c9dc25]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:40 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:40 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0648769480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7250b11-6205-4833-95fc-e5b701dad2d6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[925839f5-40d8-4584-bd52-b7436adb6db5]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[58814e13-b4f1-4bba-8180-d7c0fcc153e7]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.106s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0e311f-73da-4336-907b-9bf2b8fdb5e7]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5451b4a-25a2-40a6-a762-3c400eab1d52]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[999f461e-115a-48c7-b3ed-cfa5de2e332f]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260]
Jul 31 12:20:40 user nova-compute[72447]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3, portal: 172.16.0.220,3260] successful.
Jul 31 12:20:40 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b7d15ea-d519-4598-a858-d87931572ea3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f148100e-9f40-49cd-9e93-8a9c14cdc41a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] <== disconnect_volume: return (361ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.300s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:40 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:40 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6a93e8-e8d8-430f-bed9-f89acb9a1174]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AbGehHtk\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 31 12:20:40 user nova-compute[72447]: node.name = iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466
Jul 31 12:20:40 user nova-compute[72447]: node.tpgt = -1
Jul 31 12:20:40 user nova-compute[72447]: node.startup = automatic
Jul 31 12:20:40 user nova-compute[72447]: node.leading_login = No
Jul 31 12:20:40 user nova-compute[72447]: iface.iscsi_ifacename = default
Jul 31 12:20:40 user nova-compute[72447]: iface.net_ifacename = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.ipaddress = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.prefix_len = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.hwaddress = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.transport_name = tcp
Jul 31 12:20:40 user nova-compute[72447]: iface.initiatorname = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.state = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.vlan_id = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.vlan_priority = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.vlan_state = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.iface_num = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.mtu = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.port = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.bootproto = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.subnet_mask = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.gateway = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.dhcp_alt_client_id_state = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.dhcp_alt_client_id = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.dhcp_dns = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.dhcp_learn_iqn = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.dhcp_req_vendor_id_state = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.dhcp_vendor_id_state = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.dhcp_vendor_id = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.dhcp_slp_da = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.fragmentation = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.gratuitous_arp = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.incoming_forwarding = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.tos_state = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.tos = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.ttl = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.delayed_ack = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.tcp_nagle = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.tcp_wsf_state = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.tcp_wsf = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.tcp_timer_scale = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.tcp_timestamp = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.redirect = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.def_task_mgmt_timeout = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.header_digest = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.data_digest = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.immediate_data = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.initial_r2t = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.data_seq_inorder = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.data_pdu_inorder = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.erl = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.max_receive_data_len = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.first_burst_len = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.max_outstanding_r2t = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.max_burst_len = 0
Jul 31 12:20:40 user nova-compute[72447]: iface.chap_auth = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.bidi_chap = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.strict_login_compliance = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.discovery_auth = <empty>
Jul 31 12:20:40 user nova-compute[72447]: iface.discovery_logout = <empty>
Jul 31 12:20:40 user nova-compute[72447]: node.discovery_address = <empty>
Jul 31 12:20:40 user nova-compute[72447]: node.discovery_port = 0
Jul 31 12:20:40 user nova-compute[72447]: node.discovery_type = static
Jul 31 12:20:40 user nova-compute[72447]: node.session.initial_cmdsn = 0
Jul 31 12:20:40 user nova-compute[72447]: node.session.initial_login_retry_max = 8
Jul 31 12:20:40 user nova-compute[72447]: node.session.xmit_thread_priority = -20
Jul 31 12:20:40 user nova-compute[72447]: node.session.cmds_max = 128
Jul 31 12:20:40 user nova-compute[72447]: node.session.queue_depth = 32
Jul 31 12:20:40 user nova-compute[72447]: node.session.nr_sessions = 1
Jul 31 12:20:40 user nova-compute[72447]: node.session.auth.authmethod = CHAP
Jul 31 12:20:40 user nova-compute[72447]: node.session.auth.username = AbGehHtk
Jul 31 12:20:40 user nova-compute[72447]: node.session.auth.password = ***
Jul 31 12:20:40 user nova-compute[72447]: node.session.auth.username_in = <empty>
Jul 31 12:20:40 user nova-compute[72447]: node.session.auth.password_in = <empty>
Jul 31 12:20:40 user nova-compute[72447]: node.session.auth.chap_algs = MD5
Jul 31 12:20:40 user nova-compute[72447]: node.session.timeo.replacement_timeout = 120
Jul 31 12:20:40 user nova-compute[72447]: node.session.err_timeo.abort_timeout = 15
Jul 31 12:20:40 user nova-compute[72447]: node.session.err_timeo.lu_reset_timeout = 30
Jul 31 12:20:40 user nova-compute[72447]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 31 12:20:40 user nova-compute[72447]: node.session.err_timeo.host_reset_timeout = 60
Jul 31 12:20:40 user nova-compute[72447]: node.session.iscsi.FastAbort = Yes
Jul 31 12:20:40 user nova-compute[72447]: node.session.iscsi.InitialR2T = No
Jul 31 12:20:40 user nova-compute[72447]: node.session.iscsi.ImmediateData = Yes
Jul 31 12:20:40 user nova-compute[72447]: node.session.iscsi.FirstBurstLength = 262144
Jul 31 12:20:40 user nova-compute[72447]: node.session.iscsi.MaxBurstLength = 16776192
Jul 31 12:20:40 user nova-compute[72447]: node.session.iscsi.DefaultTime2Retain = 0
Jul 31 12:20:40 user nova-compute[72447]: node.session.iscsi.DefaultTime2Wait = 2
Jul 31 12:20:40 user nova-compute[72447]: node.session.iscsi.MaxConnections = 1
Jul 31 12:20:40 user nova-compute[72447]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 31 12:20:40 user nova-compute[72447]: node.session.iscsi.ERL = 0
Jul 31 12:20:40 user nova-compute[72447]: node.session.scan = manual
Jul 31 12:20:40 user nova-compute[72447]: node.session.reopen_max = 0
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].address = 172.16.0.220
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].port = 3260
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].startup = manual
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].tcp.window_size = 524288
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].tcp.type_of_service = 0
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].timeo.logout_timeout = 15
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].timeo.login_timeout = 15
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].timeo.auth_timeout = 45
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].timeo.noop_out_interval = 5
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].timeo.noop_out_timeout = 5
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].iscsi.HeaderDigest = None
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].iscsi.DataDigest = None
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].iscsi.IFMarker = No
Jul 31 12:20:40 user nova-compute[72447]: node.conn[0].iscsi.OFMarker = No
Jul 31 12:20:40 user nova-compute[72447]: # END RECORD
Jul 31 12:20:40 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8b7b0f-dc2c-421c-9cfe-7971833bc50f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6dc3b3-e6f8-4ce5-8a1a-8a20849e4b37]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbGehHtk {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbGehHtk" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd6c969-f8e4-4b41-891e-9bf45f50f4d2]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AbGehHtk'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[082dbb1e-fbd7-4645-a53f-eeaebc06c060]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c947b28-caf2-40c7-b6b5-b6ebecd898ab]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:40 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:40 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:40 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.155s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] HCTL ('34', '0', '0', 0) found on session 21 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54ace49-a3e2-4a38-96a8-10d4fb09e2b2]: (4, ('0 0 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching for a device in session 21 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbGehHtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.179s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] <== connect_volume: return (479ms) {'type': 'block', 'scsi_wwn': '23965613463396265', 'path': '/dev/sdc'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965613463396265', 'path': '/dev/sdc'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-444683405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-444683405',id=23,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:19:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-io8hutry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:19:07Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=0dbd2353-0521-4e92-8722-6151bfb40924,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "vif_mac": "fa:16:3e:81:a7:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "vif_mac": "fa:16:3e:81:a7:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:a7:b9,bridge_name='br-int',has_traffic_filtering=True,id=7e1213ee-4076-42af-a8cb-d3825739d314,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1213ee-40') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.objects.instance [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dbd2353-0521-4e92-8722-6151bfb40924 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:20:40 user nova-compute[72447]:   <uuid>0dbd2353-0521-4e92-8722-6151bfb40924</uuid>
Jul 31 12:20:40 user nova-compute[72447]:   <name>instance-00000017</name>
Jul 31 12:20:40 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:20:40 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:20:40 user nova-compute[72447]:   <metadata>
Jul 31 12:20:40 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:20:40 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:20:40 user nova-compute[72447]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-444683405</nova:name>
Jul 31 12:20:40 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:20:40</nova:creationTime>
Jul 31 12:20:40 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:20:40 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:20:40 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:20:40 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:20:40 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:20:40 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:20:40 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:20:40 user nova-compute[72447]:       <nova:owner>
Jul 31 12:20:40 user nova-compute[72447]:         <nova:user uuid="33268392189342ecbca53c9ad959245e">tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member</nova:user>
Jul 31 12:20:40 user nova-compute[72447]:         <nova:project uuid="a055fae579aa4858867824625e8bd18d">tempest-ServerBootFromVolumeStableRescueTest-1637857313</nova:project>
Jul 31 12:20:40 user nova-compute[72447]:       </nova:owner>
Jul 31 12:20:40 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:20:40 user nova-compute[72447]:       <nova:ports>
Jul 31 12:20:40 user nova-compute[72447]:         <nova:port uuid="7e1213ee-4076-42af-a8cb-d3825739d314">
Jul 31 12:20:40 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 12:20:40 user nova-compute[72447]:         </nova:port>
Jul 31 12:20:40 user nova-compute[72447]:       </nova:ports>
Jul 31 12:20:40 user nova-compute[72447]:     </nova:instance>
Jul 31 12:20:40 user nova-compute[72447]:   </metadata>
Jul 31 12:20:40 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:20:40 user nova-compute[72447]:     <system>
Jul 31 12:20:40 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:20:40 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:20:40 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:20:40 user nova-compute[72447]:       <entry name="serial">0dbd2353-0521-4e92-8722-6151bfb40924</entry>
Jul 31 12:20:40 user nova-compute[72447]:       <entry name="uuid">0dbd2353-0521-4e92-8722-6151bfb40924</entry>
Jul 31 12:20:40 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:20:40 user nova-compute[72447]:     </system>
Jul 31 12:20:40 user nova-compute[72447]:   </sysinfo>
Jul 31 12:20:40 user nova-compute[72447]:   <os>
Jul 31 12:20:40 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:20:40 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:20:40 user nova-compute[72447]:   </os>
Jul 31 12:20:40 user nova-compute[72447]:   <features>
Jul 31 12:20:40 user nova-compute[72447]:     <acpi/>
Jul 31 12:20:40 user nova-compute[72447]:     <apic/>
Jul 31 12:20:40 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:20:40 user nova-compute[72447]:   </features>
Jul 31 12:20:40 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:20:40 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:20:40 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:20:40 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:20:40 user nova-compute[72447]:   </clock>
Jul 31 12:20:40 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:20:40 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:20:40 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:20:40 user nova-compute[72447]:   </cpu>
Jul 31 12:20:40 user nova-compute[72447]:   <devices>
Jul 31 12:20:40 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:20:40 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:20:40 user nova-compute[72447]:       <source dev="/dev/sdc"/>
Jul 31 12:20:40 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:20:40 user nova-compute[72447]:       <serial>5c390fca-f26f-4a6f-8340-a3037945e466</serial>
Jul 31 12:20:40 user nova-compute[72447]:     </disk>
Jul 31 12:20:40 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:20:40 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:20:40 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.rescue"/>
Jul 31 12:20:40 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:20:40 user nova-compute[72447]:       <boot order="1"/>
Jul 31 12:20:40 user nova-compute[72447]:     </disk>
Jul 31 12:20:40 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:20:40 user nova-compute[72447]:       <mac address="fa:16:3e:81:a7:b9"/>
Jul 31 12:20:40 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:20:40 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:20:40 user nova-compute[72447]:       <target dev="tap7e1213ee-40"/>
Jul 31 12:20:40 user nova-compute[72447]:     </interface>
Jul 31 12:20:40 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:20:40 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/console.log" append="off"/>
Jul 31 12:20:40 user nova-compute[72447]:     </serial>
Jul 31 12:20:40 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:20:40 user nova-compute[72447]:     <video>
Jul 31 12:20:40 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:20:40 user nova-compute[72447]:     </video>
Jul 31 12:20:40 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:20:40 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:20:40 user nova-compute[72447]:     </rng>
Jul 31 12:20:40 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:20:40 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:20:40 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:20:40 user nova-compute[72447]:     </memballoon>
Jul 31 12:20:40 user nova-compute[72447]:   </devices>
Jul 31 12:20:40 user nova-compute[72447]: </domain>
Jul 31 12:20:40 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:20:40 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Instance destroyed successfully.
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:20:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No VIF found with MAC fa:16:3e:81:a7:b9, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlLqOyxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:41 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:41 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:41 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4b8be1-dff4-4193-8d9c-a7a56b2ee36e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:20:41 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c22c6f8-d199-43ed-81ae-9d2303dcb2fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6] added
Jul 31 12:20:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4964605-3b88-419e-873f-b83e8f6ceac5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG nova.objects.instance [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'flavor' on Instance uuid e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ca144c-6312-4ebf-957f-e4be4e22b460]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GlLqOyxc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GlLqOyxc" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1d42f1-2a1e-4b12-be7f-1e3f397b7903]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b9efd9ab-f9a5-47c3-afc8-ccdceb3b71f0 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.943s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GlLqOyxc'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea573b6-9c83-4cfd-8d89-88ed78782700]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[383d31c2-98c2-401c-8c7f-498ee1793e8b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9cb252-12e1-43a3-834b-f00bd9bb20be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6, portal: 172.16.0.220,3260]
Jul 31 12:20:41 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6, portal: 172.16.0.220,3260] successful.
Jul 31 12:20:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[395a91f8-9082-4b2b-993a-70756890a04d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2d97ba-c262-4045-9bc8-163530b06e3f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 (non-flash)
Jul 31 12:20:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:41 user nova-compute[72447]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 (non-flash)
Jul 31 12:20:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a9e8bc-fb72-4d9e-95e1-daa9cacd0589]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlLqOyxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "08c02c81-b860-45e8-a4e0-126b2151c601" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "08c02c81-b860-45e8-a4e0-126b2151c601" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:41 user nova-compute[72447]: INFO nova.compute.manager [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Terminating instance
Jul 31 12:20:41 user nova-compute[72447]: DEBUG nova.compute.manager [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-c0fcf3ad-b86f-472b-bfb4-65b5a09223d3 req-dc45fbea-3b8f-4377-8387-7031d6cfadea service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Received event network-vif-unplugged-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c0fcf3ad-b86f-472b-bfb4-65b5a09223d3 req-dc45fbea-3b8f-4377-8387-7031d6cfadea service nova] Acquiring lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c0fcf3ad-b86f-472b-bfb4-65b5a09223d3 req-dc45fbea-3b8f-4377-8387-7031d6cfadea service nova] Lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c0fcf3ad-b86f-472b-bfb4-65b5a09223d3 req-dc45fbea-3b8f-4377-8387-7031d6cfadea service nova] Lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-c0fcf3ad-b86f-472b-bfb4-65b5a09223d3 req-dc45fbea-3b8f-4377-8387-7031d6cfadea service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] No waiting events found dispatching network-vif-unplugged-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-c0fcf3ad-b86f-472b-bfb4-65b5a09223d3 req-dc45fbea-3b8f-4377-8387-7031d6cfadea service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Received event network-vif-unplugged-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26230353637396562', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230353637396562', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG nova.objects.instance [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lazy-loading 'flavor' on Instance uuid b291ba57-9fdb-48f2-ac0c-45a108dda3b1 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:20:42 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:20:42 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:20:42 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:20:42 user nova-compute[72447]:   <serial>50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6</serial>
Jul 31 12:20:42 user nova-compute[72447]: </disk>
Jul 31 12:20:42 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:20:43 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Instance destroyed successfully.
Jul 31 12:20:43 user nova-compute[72447]: DEBUG nova.objects.instance [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'resources' on Instance uuid 08c02c81-b860-45e8-a4e0-126b2151c601 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1158370807',display_name='tempest-AttachVolumeNegativeTest-server-1158370807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1158370807',id=20,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkghjF3MhVzmQ2UwDHqD4+sdLVSilnbco6WCT1cTmqQP2sco2YbmDng6go6PH3sP6QptnGZtxhNKISUZeSg21eiZbFtEoW+nnObRJjhiVWsIWUewiLSNPR1aI6j/9hsmQ==',key_name='tempest-keypair-404129790',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:17:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fad40b5f5e54e7ab9c6f8e78ceb3947',ramdisk_id='',reservation_id='r-rntfxrto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-323727931',owner_user_name='tempest-AttachVolumeNegativeTest-323727931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a7feffde0f74f63a6bd027c1958aacb',uuid=08c02c81-b860-45e8-a4e0-126b2151c601,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "address": "fa:16:3e:ef:a6:a1", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0af4fb-e6", "ovs_interfaceid": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converting VIF {"id": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "address": "fa:16:3e:ef:a6:a1", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0af4fb-e6", "ovs_interfaceid": "ae0af4fb-e6c1-4711-a186-c8eee0acf7cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=ae0af4fb-e6c1-4711-a186-c8eee0acf7cd,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0af4fb-e6') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG os_vif [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=ae0af4fb-e6c1-4711-a186-c8eee0acf7cd,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0af4fb-e6') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae0af4fb-e6, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:43 user nova-compute[72447]: INFO os_vif [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=ae0af4fb-e6c1-4711-a186-c8eee0acf7cd,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0af4fb-e6')
Jul 31 12:20:43 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Deleting instance files /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601_del
Jul 31 12:20:43 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Deletion of /opt/stack/data/nova/instances/08c02c81-b860-45e8-a4e0-126b2151c601_del complete
Jul 31 12:20:43 user nova-compute[72447]: INFO nova.compute.manager [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Took 1.25 seconds to destroy the instance on the hypervisor.
Jul 31 12:20:43 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] No VIF found with MAC fa:16:3e:59:1a:27, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:20:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9068d832-517e-4ffd-84c7-3dfa87352327 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.699s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:20:44 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Took 1.01 seconds to deallocate network for instance.
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-6a98cb4f-1867-4abd-9dfb-fa087f06ed13 req-7dbc10cf-c8ee-4025-95bd-ae9d10b9224d service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Received event network-vif-deleted-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Received event network-vif-plugged-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] Acquiring lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] Lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] Lock "08c02c81-b860-45e8-a4e0-126b2151c601-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] No waiting events found dispatching network-vif-plugged-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:44 user nova-compute[72447]: WARNING nova.compute.manager [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Received unexpected event network-vif-plugged-ae0af4fb-e6c1-4711-a186-c8eee0acf7cd for instance with vm_state deleted and task_state None.
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] No waiting events found dispatching network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:44 user nova-compute[72447]: WARNING nova.compute.manager [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received unexpected event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 for instance with vm_state active and task_state rescuing.
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] No waiting events found dispatching network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:44 user nova-compute[72447]: WARNING nova.compute.manager [req-655cd920-89c3-4e84-8073-402975fcccf7 req-63803c3c-dec6-4643-9bf9-ea4fccb6ea36 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received unexpected event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 for instance with vm_state active and task_state rescuing.
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:44 user nova-compute[72447]: INFO nova.compute.manager [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Detaching volume 50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6
Jul 31 12:20:44 user nova-compute[72447]: INFO nova.virt.block_device [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Attempting to driver detach volume 50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 from mountpoint /dev/vdb
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Attempting to detach device vdb from instance b291ba57-9fdb-48f2-ac0c-45a108dda3b1 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:20:44 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:20:44 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:20:44 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:20:44 user nova-compute[72447]:   <serial>50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6</serial>
Jul 31 12:20:44 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:20:44 user nova-compute[72447]: </disk>
Jul 31 12:20:44 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:20:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Successfully detached device vdb from instance b291ba57-9fdb-48f2-ac0c-45a108dda3b1 from the persistent domain config.
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b291ba57-9fdb-48f2-ac0c-45a108dda3b1 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:20:44 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:20:44 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:20:44 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:20:44 user nova-compute[72447]:   <serial>50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6</serial>
Jul 31 12:20:44 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:20:44 user nova-compute[72447]: </disk>
Jul 31 12:20:44 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:44 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Deleted allocations for instance 08c02c81-b860-45e8-a4e0-126b2151c601
Jul 31 12:20:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-09d12519-cbd4-459c-8d02-35271ab18b53 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "08c02c81-b860-45e8-a4e0-126b2151c601" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.944s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806045.021001, b291ba57-9fdb-48f2-ac0c-45a108dda3b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b291ba57-9fdb-48f2-ac0c-45a108dda3b1 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:20:45 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Successfully detached device vdb from instance b291ba57-9fdb-48f2-ac0c-45a108dda3b1 from the live domain config.
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlLqOyxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:45 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0965cce2-7410-4052-abca-e76b493a1e77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[683bb2be-b068-4233-8ec4-db7eeb5e43b2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:45 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:45 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:45 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:45 user nova-compute[72447]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 (non-flash)
Jul 31 12:20:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:45 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:45 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:45 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:45 user nova-compute[72447]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 (non-flash)
Jul 31 12:20:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06487692d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cd46c9-f496-4fb3-b130-f00a234f5bbd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edec6d5-4f8c-49ff-a2ab-6dfde3727f7e]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[457888b9-5874-4e67-8198-f239e5d1d4cc]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 0dbd2353-0521-4e92-8722-6151bfb40924 due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806045.1815386, 0dbd2353-0521-4e92-8722-6151bfb40924 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:20:45 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] VM Resumed (Lifecycle Event)
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-f9f41b9c-6b7e-40f5-8463-65e3b2c2643f tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[63431986-bdd6-45aa-ad47-98fc64341e17]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5a0fdb-f070-4758-933d-bbfadb73fa42]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:45 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806045.1919062, 0dbd2353-0521-4e92-8722-6151bfb40924 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:20:45 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] VM Started (Lifecycle Event)
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e24f080-c84c-47e8-b5c4-5111ef1195a3]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6, portal: 172.16.0.220,3260]
Jul 31 12:20:45 user nova-compute[72447]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6, portal: 172.16.0.220,3260] successful.
Jul 31 12:20:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50c2e9a6-d4ab-4540-ab17-13d79f4d5ec6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[93df2bd0-a802-4d20-b871-08e1bf560542]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] <== disconnect_volume: return (305ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:45 user nova-compute[72447]: INFO nova.compute.manager [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Terminating instance
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-52e771f3-f8cc-4bb7-9cf1-8e8d76027da3 req-619a21df-edab-455b-9428-5c8f30df5fcc service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event network-vif-unplugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-52e771f3-f8cc-4bb7-9cf1-8e8d76027da3 req-619a21df-edab-455b-9428-5c8f30df5fcc service nova] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-52e771f3-f8cc-4bb7-9cf1-8e8d76027da3 req-619a21df-edab-455b-9428-5c8f30df5fcc service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-52e771f3-f8cc-4bb7-9cf1-8e8d76027da3 req-619a21df-edab-455b-9428-5c8f30df5fcc service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-52e771f3-f8cc-4bb7-9cf1-8e8d76027da3 req-619a21df-edab-455b-9428-5c8f30df5fcc service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] No waiting events found dispatching network-vif-unplugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-52e771f3-f8cc-4bb7-9cf1-8e8d76027da3 req-619a21df-edab-455b-9428-5c8f30df5fcc service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event network-vif-unplugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lazy-loading 'flavor' on Instance uuid b291ba57-9fdb-48f2-ac0c-45a108dda3b1 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-69e5b5c2-d14a-41c4-97b2-d4df168e062d tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.768s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Instance destroyed successfully.
Jul 31 12:20:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lazy-loading 'resources' on Instance uuid c3a723a9-2a7f-46b9-a326-501d77ad7c16 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1499780947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1455078153',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECGXIy4PDnzg6ek+j2HG9HwhyLJVMPlacwsNKl7bNxDhJp0QusrhfASjEy/UNcWcKH7CNfC2QWxQjStvqwQeEecRmaAyf/xqGPScqaT5/FIjyOOce+GAHOyAskfUB7sFg==',key_name='tempest-keypair-1780767399',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fefc91464b24c68a6d7f9059ec58b5f',ramdisk_id='',reservation_id='r-fif9fh4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1359270950',owner_user_name='tempest-ServerActionsV293TestJSON-1359270950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:19:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855a22b65634f1690901a5f9be8e885',uuid=c3a723a9-2a7f-46b9-a326-501d77ad7c16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converting VIF {"id": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "address": "fa:16:3e:cb:98:95", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b84f682-ff", "ovs_interfaceid": "2b84f682-ff0f-447b-ab90-bc71768a0b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_vif [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b84f682-ff, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:46 user nova-compute[72447]: INFO os_vif [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:95,bridge_name='br-int',has_traffic_filtering=True,id=2b84f682-ff0f-447b-ab90-bc71768a0b31,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b84f682-ff')
Jul 31 12:20:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCOzraS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:20:46 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba81e91-ea59-455f-869e-a2645708b0ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfb5beb-c7d1-4823-ac75-8a43b516f76e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:46 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:46 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:46 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:46 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:20:46 user nova-compute[72447]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb (non-flash)
Jul 31 12:20:46 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:20:46 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:20:46 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f067c527a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb'): ({'sdd'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Removing single pathed devices sdd {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e56033e-ebb0-4926-bfcf-8791c752bafb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4c3502-3e4b-4fda-8426-85110a4b640e]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Flushing IO for device /dev/sdd {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad19592-36e2-4933-8230-600d02a1dfde]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[926bff83-5dcf-44aa-8cbf-1cf227620be7]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd7e3fe84-515b181c09000dd1', '/dev/disk/by-id/scsi-23531356231383163', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d7e3fe84') {{(pid=83492) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[301574d7-41a8-4a7f-8d32-4a96c74613ea]: (4, None) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f557f0e6-3855-4c28-ab7b-b47a363e8467]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[508cd6b2-39a7-4963-86c6-209afebec13b]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260]
Jul 31 12:20:46 user nova-compute[72447]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb, portal: 172.16.0.220,3260] successful.
Jul 31 12:20:46 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b539fc01-3bf0-4434-af06-2dab7489b970]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] <== disconnect_volume: return (316ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:20:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Deleting instance files /opt/stack/data/nova/instances/c3a723a9-2a7f-46b9-a326-501d77ad7c16_del
Jul 31 12:20:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Deletion of /opt/stack/data/nova/instances/c3a723a9-2a7f-46b9-a326-501d77ad7c16_del complete
Jul 31 12:20:46 user nova-compute[72447]: INFO nova.compute.manager [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 31 12:20:46 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:20:46 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:20:47 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:20:47 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Took 0.75 seconds to deallocate network for instance.
Jul 31 12:20:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-b693fafd-130d-4fd8-9167-4b1a5abbd08f req-d4d2c3b1-7556-451f-9748-6149d362e079 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event network-vif-deleted-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-98736387-7e5f-48a7-af1b-00f505a5365e req-ccef4c8f-8d81-447b-bc42-bd32d38d3245 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received event network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:20:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-98736387-7e5f-48a7-af1b-00f505a5365e req-ccef4c8f-8d81-447b-bc42-bd32d38d3245 service nova] Acquiring lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-98736387-7e5f-48a7-af1b-00f505a5365e req-ccef4c8f-8d81-447b-bc42-bd32d38d3245 service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-98736387-7e5f-48a7-af1b-00f505a5365e req-ccef4c8f-8d81-447b-bc42-bd32d38d3245 service nova] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-98736387-7e5f-48a7-af1b-00f505a5365e req-ccef4c8f-8d81-447b-bc42-bd32d38d3245 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] No waiting events found dispatching network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:20:47 user nova-compute[72447]: WARNING nova.compute.manager [req-98736387-7e5f-48a7-af1b-00f505a5365e req-ccef4c8f-8d81-447b-bc42-bd32d38d3245 service nova] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Received unexpected event network-vif-plugged-2b84f682-ff0f-447b-ab90-bc71768a0b31 for instance with vm_state active and task_state deleting.
Jul 31 12:20:48 user nova-compute[72447]: INFO nova.compute.manager [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Took 0.72 seconds to detach 1 volumes for instance.
Jul 31 12:20:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Deleting volume: f9b401bc-2f04-4bfb-9633-d7f01bb1c0eb {{(pid=72447) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:48 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Deleted allocations for instance c3a723a9-2a7f-46b9-a326-501d77ad7c16
Jul 31 12:20:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updating instance_info_cache with network_info: [{"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-639f6182-1cef-4d6a-8872-06a222c42d81 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "c3a723a9-2a7f-46b9-a326-501d77ad7c16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.391s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:20:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:20:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:51 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:20:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:20:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:20:53 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:20:54 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:20:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:20:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806043.0197234, 08c02c81-b860-45e8-a4e0-126b2151c601 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:20:58 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] VM Stopped (Lifecycle Event)
Jul 31 12:20:58 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4a8fc721-a885-4f69-9d56-41d595cfa0a0 None None] [instance: 08c02c81-b860-45e8-a4e0-126b2151c601] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:20:59 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:20:59 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=6957MB free_disk=25.082683563232422GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Applying migration context for instance 92ff498b-1337-47da-aaf1-b5fb9f19e98d as it has an incoming, in-progress migration 1e8c9167-6f72-47da-b260-8c1b3375469d. Migration status is finished {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 12:20:59 user nova-compute[72447]: INFO nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating resource usage from migration 1e8c9167-6f72-47da-b260-8c1b3375469d
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2f98bc8b-537a-4b34-85ce-d7baac240046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance e75d2046-19d7-46b8-9c63-5af205c87c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b291ba57-9fdb-48f2-ac0c-45a108dda3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b5fe9835-8278-449e-9069-18421cb088dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 483f6f7a-c61d-46dd-893b-29b80da3f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Migration 1e8c9167-6f72-47da-b260-8c1b3375469d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 92ff498b-1337-47da-aaf1-b5fb9f19e98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:20:59 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:21:00 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:21:00 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:21:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:21:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:01 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806046.2876182, c3a723a9-2a7f-46b9-a326-501d77ad7c16 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:21:01 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] VM Stopped (Lifecycle Event)
Jul 31 12:21:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-7412ae6f-3bc0-4823-a91e-22289705ac4b None None] [instance: c3a723a9-2a7f-46b9-a326-501d77ad7c16] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:21:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:21:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:21:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "6958347e-bd3b-4f4a-ae78-c282d7849a57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:21:15 user nova-compute[72447]: INFO nova.compute.claims [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Claim successful on node user
Jul 31 12:21:15 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:21:15 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:21:15 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:21:15 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Creating image(s)
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "/opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "/opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "/opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG nova.policy [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2c57df148eb4814a0b12ca7a6d9eda6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94646a9f184c43d4abbd4fac64c84344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.130s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk 1073741824" returned: 0 in 0.048s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Cannot resize image /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lazy-loading 'migration_context' on Instance uuid 6958347e-bd3b-4f4a-ae78-c282d7849a57 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Successfully created port: e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Ensure instance console log exists: /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:17 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Successfully updated port: e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:21:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "refresh_cache-6958347e-bd3b-4f4a-ae78-c282d7849a57" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:21:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquired lock "refresh_cache-6958347e-bd3b-4f4a-ae78-c282d7849a57" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:21:17 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:21:17 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:21:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-137bfe31-c64b-438d-8900-507e0f26979e req-5f573095-d527-439e-b5c2-e5c2503c911a service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Received event network-changed-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-137bfe31-c64b-438d-8900-507e0f26979e req-5f573095-d527-439e-b5c2-e5c2503c911a service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Refreshing instance network info cache due to event network-changed-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:21:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-137bfe31-c64b-438d-8900-507e0f26979e req-5f573095-d527-439e-b5c2-e5c2503c911a service nova] Acquiring lock "refresh_cache-6958347e-bd3b-4f4a-ae78-c282d7849a57" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Updating instance_info_cache with network_info: [{"id": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "address": "fa:16:3e:db:2a:ed", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e7b3ce-27", "ovs_interfaceid": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Releasing lock "refresh_cache-6958347e-bd3b-4f4a-ae78-c282d7849a57" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Instance network_info: |[{"id": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "address": "fa:16:3e:db:2a:ed", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e7b3ce-27", "ovs_interfaceid": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-137bfe31-c64b-438d-8900-507e0f26979e req-5f573095-d527-439e-b5c2-e5c2503c911a service nova] Acquired lock "refresh_cache-6958347e-bd3b-4f4a-ae78-c282d7849a57" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.network.neutron [req-137bfe31-c64b-438d-8900-507e0f26979e req-5f573095-d527-439e-b5c2-e5c2503c911a service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Refreshing network info cache for port e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Start _get_guest_xml network_info=[{"id": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "address": "fa:16:3e:db:2a:ed", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e7b3ce-27", "ovs_interfaceid": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:21:18 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:21:18 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-441145672',display_name='tempest-ServersNegativeTestJSON-server-441145672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-441145672',id=26,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94646a9f184c43d4abbd4fac64c84344',ramdisk_id='',reservation_id='r-e9linpdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1687226877',owner_user_name='tempest-ServersNegativeTestJSON-1687226877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:21:16Z,user_data=None,user_id='f2c57df148eb4814a0b12ca7a6d9eda6',uuid=6958347e-bd3b-4f4a-ae78-c282d7849a57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "address": "fa:16:3e:db:2a:ed", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e7b3ce-27", "ovs_interfaceid": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Converting VIF {"id": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "address": "fa:16:3e:db:2a:ed", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e7b3ce-27", "ovs_interfaceid": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6e7b3ce-27ab-426c-ad51-5e09fe4741a0,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e7b3ce-27') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lazy-loading 'pci_devices' on Instance uuid 6958347e-bd3b-4f4a-ae78-c282d7849a57 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:21:18 user nova-compute[72447]:   <uuid>6958347e-bd3b-4f4a-ae78-c282d7849a57</uuid>
Jul 31 12:21:18 user nova-compute[72447]:   <name>instance-0000001a</name>
Jul 31 12:21:18 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:21:18 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:21:18 user nova-compute[72447]:   <metadata>
Jul 31 12:21:18 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:21:18 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:21:18 user nova-compute[72447]:       <nova:name>tempest-ServersNegativeTestJSON-server-441145672</nova:name>
Jul 31 12:21:18 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:21:18</nova:creationTime>
Jul 31 12:21:18 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:21:18 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:21:18 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:21:18 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:21:18 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:21:18 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:21:18 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:21:18 user nova-compute[72447]:       <nova:owner>
Jul 31 12:21:18 user nova-compute[72447]:         <nova:user uuid="f2c57df148eb4814a0b12ca7a6d9eda6">tempest-ServersNegativeTestJSON-1687226877-project-member</nova:user>
Jul 31 12:21:18 user nova-compute[72447]:         <nova:project uuid="94646a9f184c43d4abbd4fac64c84344">tempest-ServersNegativeTestJSON-1687226877</nova:project>
Jul 31 12:21:18 user nova-compute[72447]:       </nova:owner>
Jul 31 12:21:18 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:21:18 user nova-compute[72447]:       <nova:ports>
Jul 31 12:21:18 user nova-compute[72447]:         <nova:port uuid="e6e7b3ce-27ab-426c-ad51-5e09fe4741a0">
Jul 31 12:21:18 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 12:21:18 user nova-compute[72447]:         </nova:port>
Jul 31 12:21:18 user nova-compute[72447]:       </nova:ports>
Jul 31 12:21:18 user nova-compute[72447]:     </nova:instance>
Jul 31 12:21:18 user nova-compute[72447]:   </metadata>
Jul 31 12:21:18 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:21:18 user nova-compute[72447]:     <system>
Jul 31 12:21:18 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:21:18 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:21:18 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:21:18 user nova-compute[72447]:       <entry name="serial">6958347e-bd3b-4f4a-ae78-c282d7849a57</entry>
Jul 31 12:21:18 user nova-compute[72447]:       <entry name="uuid">6958347e-bd3b-4f4a-ae78-c282d7849a57</entry>
Jul 31 12:21:18 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:21:18 user nova-compute[72447]:     </system>
Jul 31 12:21:18 user nova-compute[72447]:   </sysinfo>
Jul 31 12:21:18 user nova-compute[72447]:   <os>
Jul 31 12:21:18 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:21:18 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:21:18 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:21:18 user nova-compute[72447]:   </os>
Jul 31 12:21:18 user nova-compute[72447]:   <features>
Jul 31 12:21:18 user nova-compute[72447]:     <acpi/>
Jul 31 12:21:18 user nova-compute[72447]:     <apic/>
Jul 31 12:21:18 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:21:18 user nova-compute[72447]:   </features>
Jul 31 12:21:18 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:21:18 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:21:18 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:21:18 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:21:18 user nova-compute[72447]:   </clock>
Jul 31 12:21:18 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:21:18 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:21:18 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:21:18 user nova-compute[72447]:   </cpu>
Jul 31 12:21:18 user nova-compute[72447]:   <devices>
Jul 31 12:21:18 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:21:18 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:21:18 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk"/>
Jul 31 12:21:18 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:21:18 user nova-compute[72447]:     </disk>
Jul 31 12:21:18 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:21:18 user nova-compute[72447]:       <mac address="fa:16:3e:db:2a:ed"/>
Jul 31 12:21:18 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:21:18 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:21:18 user nova-compute[72447]:       <target dev="tape6e7b3ce-27"/>
Jul 31 12:21:18 user nova-compute[72447]:     </interface>
Jul 31 12:21:18 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:21:18 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/console.log" append="off"/>
Jul 31 12:21:18 user nova-compute[72447]:     </serial>
Jul 31 12:21:18 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:21:18 user nova-compute[72447]:     <video>
Jul 31 12:21:18 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:21:18 user nova-compute[72447]:     </video>
Jul 31 12:21:18 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:21:18 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:21:18 user nova-compute[72447]:     </rng>
Jul 31 12:21:18 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:21:18 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:21:18 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:21:18 user nova-compute[72447]:     </memballoon>
Jul 31 12:21:18 user nova-compute[72447]:   </devices>
Jul 31 12:21:18 user nova-compute[72447]: </domain>
Jul 31 12:21:18 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-441145672',display_name='tempest-ServersNegativeTestJSON-server-441145672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-441145672',id=26,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94646a9f184c43d4abbd4fac64c84344',ramdisk_id='',reservation_id='r-e9linpdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1687226877',owner_user_name='tempest-ServersNegativeTestJSON-1687226877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:21:16Z,user_data=None,user_id='f2c57df148eb4814a0b12ca7a6d9eda6',uuid=6958347e-bd3b-4f4a-ae78-c282d7849a57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "address": "fa:16:3e:db:2a:ed", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e7b3ce-27", "ovs_interfaceid": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Converting VIF {"id": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "address": "fa:16:3e:db:2a:ed", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e7b3ce-27", "ovs_interfaceid": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6e7b3ce-27ab-426c-ad51-5e09fe4741a0,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e7b3ce-27') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG os_vif [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6e7b3ce-27ab-426c-ad51-5e09fe4741a0,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e7b3ce-27') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6e7b3ce-27, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6e7b3ce-27, col_values=(('external_ids', {'iface-id': 'e6e7b3ce-27ab-426c-ad51-5e09fe4741a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:2a:ed', 'vm-uuid': '6958347e-bd3b-4f4a-ae78-c282d7849a57'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:18 user nova-compute[72447]: INFO os_vif [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6e7b3ce-27ab-426c-ad51-5e09fe4741a0,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e7b3ce-27')
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] No VIF found with MAC fa:16:3e:db:2a:ed, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.network.neutron [req-137bfe31-c64b-438d-8900-507e0f26979e req-5f573095-d527-439e-b5c2-e5c2503c911a service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Updated VIF entry in instance network info cache for port e6e7b3ce-27ab-426c-ad51-5e09fe4741a0. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG nova.network.neutron [req-137bfe31-c64b-438d-8900-507e0f26979e req-5f573095-d527-439e-b5c2-e5c2503c911a service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Updating instance_info_cache with network_info: [{"id": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "address": "fa:16:3e:db:2a:ed", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e7b3ce-27", "ovs_interfaceid": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:21:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-137bfe31-c64b-438d-8900-507e0f26979e req-5f573095-d527-439e-b5c2-e5c2503c911a service nova] Releasing lock "refresh_cache-6958347e-bd3b-4f4a-ae78-c282d7849a57" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-0d9f497a-257a-4a3d-9dc3-9576acd533a0 req-3ac689d9-05d2-4faf-86bb-6ffdfb17d77e service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Received event network-vif-plugged-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0d9f497a-257a-4a3d-9dc3-9576acd533a0 req-3ac689d9-05d2-4faf-86bb-6ffdfb17d77e service nova] Acquiring lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0d9f497a-257a-4a3d-9dc3-9576acd533a0 req-3ac689d9-05d2-4faf-86bb-6ffdfb17d77e service nova] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0d9f497a-257a-4a3d-9dc3-9576acd533a0 req-3ac689d9-05d2-4faf-86bb-6ffdfb17d77e service nova] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-0d9f497a-257a-4a3d-9dc3-9576acd533a0 req-3ac689d9-05d2-4faf-86bb-6ffdfb17d77e service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] No waiting events found dispatching network-vif-plugged-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:19 user nova-compute[72447]: WARNING nova.compute.manager [req-0d9f497a-257a-4a3d-9dc3-9576acd533a0 req-3ac689d9-05d2-4faf-86bb-6ffdfb17d77e service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Received unexpected event network-vif-plugged-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 for instance with vm_state building and task_state spawning.
Jul 31 12:21:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-588918f3-4cfe-4d1d-adc2-d7827509c1c0 req-0d5029be-b2e6-4945-9291-7a2ca6a5c74e service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-changed-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-588918f3-4cfe-4d1d-adc2-d7827509c1c0 req-0d5029be-b2e6-4945-9291-7a2ca6a5c74e service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Refreshing instance network info cache due to event network-changed-8cdc2eae-9d44-4619-ad18-98196a439f15. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-588918f3-4cfe-4d1d-adc2-d7827509c1c0 req-0d5029be-b2e6-4945-9291-7a2ca6a5c74e service nova] Acquiring lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-588918f3-4cfe-4d1d-adc2-d7827509c1c0 req-0d5029be-b2e6-4945-9291-7a2ca6a5c74e service nova] Acquired lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:21:19 user nova-compute[72447]: DEBUG nova.network.neutron [req-588918f3-4cfe-4d1d-adc2-d7827509c1c0 req-0d5029be-b2e6-4945-9291-7a2ca6a5c74e service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Refreshing network info cache for port 8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG nova.objects.instance [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'flavor' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:20 user nova-compute[72447]: INFO nova.compute.manager [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Attaching volume 442a0967-7ca5-4e03-a09e-9ce67c2698b9 to /dev/vdb
Jul 31 12:21:20 user nova-compute[72447]: DEBUG nova.network.neutron [req-588918f3-4cfe-4d1d-adc2-d7827509c1c0 req-0d5029be-b2e6-4945-9291-7a2ca6a5c74e service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updated VIF entry in instance network info cache for port 8cdc2eae-9d44-4619-ad18-98196a439f15. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG nova.network.neutron [req-588918f3-4cfe-4d1d-adc2-d7827509c1c0 req-0d5029be-b2e6-4945-9291-7a2ca6a5c74e service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updating instance_info_cache with network_info: [{"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG os_brick.utils [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a51d801-a984-4e59-a397-6d9c381bee3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-588918f3-4cfe-4d1d-adc2-d7827509c1c0 req-0d5029be-b2e6-4945-9291-7a2ca6a5c74e service nova] Releasing lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[418510d3-8487-4381-afb1-7be4e1bb09fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dadf3e-23d1-4269-b470-4f22ed8fd8d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[533b433a-0f8b-442a-b2ad-0ddf6804f0d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:21:20 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:21:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[743885d4-87c3-4430-a5c6-8ccc72690cdc]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG os_brick.utils [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:21:20 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updating existing volume attachment record: 3c8344f7-3c5d-4767-bebe-32db66fb98e2 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806081.6945183, 6958347e-bd3b-4f4a-ae78-c282d7849a57 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:21:21 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] VM Resumed (Lifecycle Event)
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:21:21 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Instance spawned successfully.
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:21:21 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806081.696785, 6958347e-bd3b-4f4a-ae78-c282d7849a57 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:21:21 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] VM Started (Lifecycle Event)
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-6356764a-cfc1-4853-817e-ce9fa12252f0 req-b68d8fef-f902-4cc0-82ba-8686be87d102 service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Received event network-vif-plugged-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6356764a-cfc1-4853-817e-ce9fa12252f0 req-b68d8fef-f902-4cc0-82ba-8686be87d102 service nova] Acquiring lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6356764a-cfc1-4853-817e-ce9fa12252f0 req-b68d8fef-f902-4cc0-82ba-8686be87d102 service nova] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6356764a-cfc1-4853-817e-ce9fa12252f0 req-b68d8fef-f902-4cc0-82ba-8686be87d102 service nova] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-6356764a-cfc1-4853-817e-ce9fa12252f0 req-b68d8fef-f902-4cc0-82ba-8686be87d102 service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] No waiting events found dispatching network-vif-plugged-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:21 user nova-compute[72447]: WARNING nova.compute.manager [req-6356764a-cfc1-4853-817e-ce9fa12252f0 req-b68d8fef-f902-4cc0-82ba-8686be87d102 service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Received unexpected event network-vif-plugged-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 for instance with vm_state building and task_state spawning.
Jul 31 12:21:21 user nova-compute[72447]: INFO nova.compute.manager [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Took 6.13 seconds to spawn the instance on the hypervisor.
Jul 31 12:21:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:21 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:21:21 user nova-compute[72447]: INFO nova.compute.manager [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Took 6.90 seconds to build instance.
Jul 31 12:21:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5e14d3bc-294f-4041-a05f-b2f1407f4389 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.022s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnIeAJwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:21:28 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:21:28 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:21:28 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7534a2b4-2c70-4bda-89e6-6004e55889c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:21:28 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8119283-00da-4dd8-a746-1db4893765fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9] added
Jul 31 12:21:28 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3997b2ac-eb31-410b-91ee-a2a9ecf126a4]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27b6922-f7e2-4308-8ce0-bd43f207fce5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnIeAJwK {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnIeAJwK" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fed6b65-f0fe-4941-b86c-826b1425b44a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mnIeAJwK'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[309335ad-510e-4263-b251-1f54e4faf5aa]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3163f8c5-c6ba-4565-bc6f-691341a1f928]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:21:28 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:21:28 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:21:28 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:21:28 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:21:28 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:21:28 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4817db47-dbb1-4834-a7ec-6ce888edfa35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9, portal: 172.16.0.220,3260]
Jul 31 12:21:28 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9, portal: 172.16.0.220,3260] successful.
Jul 31 12:21:28 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9b4bf1-426e-42e2-9b0c-05f31348a364]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b61c40-dfa9-40aa-9cc3-8c68a4b7306d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:21:28 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:21:28 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:21:28 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:21:28 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:21:28 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:21:28 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:21:28 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:21:28 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d905a9-7f7a-4a63-9c78-cee562ddbbf3]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:21:28 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnIeAJwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:21:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:21:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23334313565323662', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:21:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334313565323662', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:21:29 user nova-compute[72447]: DEBUG nova.objects.instance [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'flavor' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:21:29 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:21:29 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:21:29 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:21:29 user nova-compute[72447]:   <serial>442a0967-7ca5-4e03-a09e-9ce67c2698b9</serial>
Jul 31 12:21:29 user nova-compute[72447]: </disk>
Jul 31 12:21:29 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:21:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:21:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:21:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No VIF found with MAC fa:16:3e:53:b0:0f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:21:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-54451fba-ea7c-4adf-bfe4-97ff14be3d60 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.770s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:31 user nova-compute[72447]: INFO nova.compute.manager [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Rescuing
Jul 31 12:21:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:21:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquired lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:21:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:21:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updating instance_info_cache with network_info: [{"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:21:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Releasing lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG nova.compute.manager [req-f2388ad0-9cfd-452c-be5e-161d599464ee req-62d6a15d-ed59-48bc-9c01-25c0a6559441 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-unplugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f2388ad0-9cfd-452c-be5e-161d599464ee req-62d6a15d-ed59-48bc-9c01-25c0a6559441 service nova] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f2388ad0-9cfd-452c-be5e-161d599464ee req-62d6a15d-ed59-48bc-9c01-25c0a6559441 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f2388ad0-9cfd-452c-be5e-161d599464ee req-62d6a15d-ed59-48bc-9c01-25c0a6559441 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG nova.compute.manager [req-f2388ad0-9cfd-452c-be5e-161d599464ee req-62d6a15d-ed59-48bc-9c01-25c0a6559441 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] No waiting events found dispatching network-vif-unplugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:32 user nova-compute[72447]: WARNING nova.compute.manager [req-f2388ad0-9cfd-452c-be5e-161d599464ee req-62d6a15d-ed59-48bc-9c01-25c0a6559441 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received unexpected event network-vif-unplugged-8cdc2eae-9d44-4619-ad18-98196a439f15 for instance with vm_state active and task_state rescuing.
Jul 31 12:21:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:32 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Instance destroyed successfully.
Jul 31 12:21:32 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Attempting rescue
Jul 31 12:21:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72447) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Instance directory exists: not creating {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 12:21:32 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Creating image(s)
Jul 31 12:21:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "/opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "/opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "/opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG nova.objects.instance [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'trusted_certs' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.rescue {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.rescue" returned: 0 in 0.062s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.objects.instance [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'migration_context' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Start _get_guest_xml network_info=[{"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "vif_mac": "fa:16:3e:53:b0:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.objects.instance [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'resources' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.objects.instance [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'numa_topology' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:33 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:21:33 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.objects.instance [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'vcpu_model' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1804070957',display_name='tempest-ServerRescueNegativeTestJSON-server-1804070957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1804070957',id=25,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU7ZXwiFgzMg8a44RrreO/XqYZIUmOE9iTP5kDtijALfeDKpqhlIcg6kobJqoZmCLWC/4Ey6eC7psG7UL1cAoLuos4YGl7QXWEIFfzxxS7LeUI4v+hNMWA7z/BWm7VB9w==',key_name='tempest-keypair-1226214134',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9576e1abb5b1475da061ca824d7c3788',ramdisk_id='',reservation_id='r-fjjnoqc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2103641702',owner_user_name='tempest-ServerRescueNegativeTestJSON-2103641702-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbcdd571b45b4450a8b27b834a05a2b6',uuid=483f6f7a-c61d-46dd-893b-29b80da3f54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "vif_mac": "fa:16:3e:53:b0:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converting VIF {"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "vif_mac": "fa:16:3e:53:b0:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:b0:0f,bridge_name='br-int',has_traffic_filtering=True,id=8cdc2eae-9d44-4619-ad18-98196a439f15,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdc2eae-9d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.objects.instance [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'pci_devices' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:21:33 user nova-compute[72447]:   <uuid>483f6f7a-c61d-46dd-893b-29b80da3f54d</uuid>
Jul 31 12:21:33 user nova-compute[72447]:   <name>instance-00000019</name>
Jul 31 12:21:33 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:21:33 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:21:33 user nova-compute[72447]:   <metadata>
Jul 31 12:21:33 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:21:33 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:21:33 user nova-compute[72447]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1804070957</nova:name>
Jul 31 12:21:33 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:21:33</nova:creationTime>
Jul 31 12:21:33 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:21:33 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:21:33 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:21:33 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:21:33 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:21:33 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:21:33 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:21:33 user nova-compute[72447]:       <nova:owner>
Jul 31 12:21:33 user nova-compute[72447]:         <nova:user uuid="cbcdd571b45b4450a8b27b834a05a2b6">tempest-ServerRescueNegativeTestJSON-2103641702-project-member</nova:user>
Jul 31 12:21:33 user nova-compute[72447]:         <nova:project uuid="9576e1abb5b1475da061ca824d7c3788">tempest-ServerRescueNegativeTestJSON-2103641702</nova:project>
Jul 31 12:21:33 user nova-compute[72447]:       </nova:owner>
Jul 31 12:21:33 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:21:33 user nova-compute[72447]:       <nova:ports>
Jul 31 12:21:33 user nova-compute[72447]:         <nova:port uuid="8cdc2eae-9d44-4619-ad18-98196a439f15">
Jul 31 12:21:33 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 12:21:33 user nova-compute[72447]:         </nova:port>
Jul 31 12:21:33 user nova-compute[72447]:       </nova:ports>
Jul 31 12:21:33 user nova-compute[72447]:     </nova:instance>
Jul 31 12:21:33 user nova-compute[72447]:   </metadata>
Jul 31 12:21:33 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:21:33 user nova-compute[72447]:     <system>
Jul 31 12:21:33 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:21:33 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:21:33 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:21:33 user nova-compute[72447]:       <entry name="serial">483f6f7a-c61d-46dd-893b-29b80da3f54d</entry>
Jul 31 12:21:33 user nova-compute[72447]:       <entry name="uuid">483f6f7a-c61d-46dd-893b-29b80da3f54d</entry>
Jul 31 12:21:33 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:21:33 user nova-compute[72447]:     </system>
Jul 31 12:21:33 user nova-compute[72447]:   </sysinfo>
Jul 31 12:21:33 user nova-compute[72447]:   <os>
Jul 31 12:21:33 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:21:33 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:21:33 user nova-compute[72447]:   </os>
Jul 31 12:21:33 user nova-compute[72447]:   <features>
Jul 31 12:21:33 user nova-compute[72447]:     <acpi/>
Jul 31 12:21:33 user nova-compute[72447]:     <apic/>
Jul 31 12:21:33 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:21:33 user nova-compute[72447]:   </features>
Jul 31 12:21:33 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:21:33 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:21:33 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:21:33 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:21:33 user nova-compute[72447]:   </clock>
Jul 31 12:21:33 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:21:33 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:21:33 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:21:33 user nova-compute[72447]:   </cpu>
Jul 31 12:21:33 user nova-compute[72447]:   <devices>
Jul 31 12:21:33 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:21:33 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:21:33 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.rescue"/>
Jul 31 12:21:33 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:21:33 user nova-compute[72447]:     </disk>
Jul 31 12:21:33 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:21:33 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:21:33 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk"/>
Jul 31 12:21:33 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:21:33 user nova-compute[72447]:     </disk>
Jul 31 12:21:33 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:21:33 user nova-compute[72447]:       <mac address="fa:16:3e:53:b0:0f"/>
Jul 31 12:21:33 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:21:33 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:21:33 user nova-compute[72447]:       <target dev="tap8cdc2eae-9d"/>
Jul 31 12:21:33 user nova-compute[72447]:     </interface>
Jul 31 12:21:33 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:21:33 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/console.log" append="off"/>
Jul 31 12:21:33 user nova-compute[72447]:     </serial>
Jul 31 12:21:33 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:21:33 user nova-compute[72447]:     <video>
Jul 31 12:21:33 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:21:33 user nova-compute[72447]:     </video>
Jul 31 12:21:33 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:21:33 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:21:33 user nova-compute[72447]:     </rng>
Jul 31 12:21:33 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:21:33 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:21:33 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:21:33 user nova-compute[72447]:     </memballoon>
Jul 31 12:21:33 user nova-compute[72447]:   </devices>
Jul 31 12:21:33 user nova-compute[72447]: </domain>
Jul 31 12:21:33 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:21:33 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Instance destroyed successfully.
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] No VIF found with MAC fa:16:3e:53:b0:0f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:33 user nova-compute[72447]: INFO nova.compute.manager [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Terminating instance
Jul 31 12:21:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-e8106f2c-b827-420e-9417-a40894f109c1 req-0a8743ae-841a-40d1-b4a9-59850dd8bbeb service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-vif-unplugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e8106f2c-b827-420e-9417-a40894f109c1 req-0a8743ae-841a-40d1-b4a9-59850dd8bbeb service nova] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e8106f2c-b827-420e-9417-a40894f109c1 req-0a8743ae-841a-40d1-b4a9-59850dd8bbeb service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e8106f2c-b827-420e-9417-a40894f109c1 req-0a8743ae-841a-40d1-b4a9-59850dd8bbeb service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-e8106f2c-b827-420e-9417-a40894f109c1 req-0a8743ae-841a-40d1-b4a9-59850dd8bbeb service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] No waiting events found dispatching network-vif-unplugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-e8106f2c-b827-420e-9417-a40894f109c1 req-0a8743ae-841a-40d1-b4a9-59850dd8bbeb service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-vif-unplugged-c491e329-e20e-47e6-893a-7643968aba7e for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:21:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-fc4351f4-41d6-41ff-af80-3ae4181a677a req-2b010513-a5e5-4d80-8731-7a080c95ba92 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fc4351f4-41d6-41ff-af80-3ae4181a677a req-2b010513-a5e5-4d80-8731-7a080c95ba92 service nova] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fc4351f4-41d6-41ff-af80-3ae4181a677a req-2b010513-a5e5-4d80-8731-7a080c95ba92 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fc4351f4-41d6-41ff-af80-3ae4181a677a req-2b010513-a5e5-4d80-8731-7a080c95ba92 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-fc4351f4-41d6-41ff-af80-3ae4181a677a req-2b010513-a5e5-4d80-8731-7a080c95ba92 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] No waiting events found dispatching network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:34 user nova-compute[72447]: WARNING nova.compute.manager [req-fc4351f4-41d6-41ff-af80-3ae4181a677a req-2b010513-a5e5-4d80-8731-7a080c95ba92 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received unexpected event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 for instance with vm_state active and task_state rescuing.
Jul 31 12:21:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Instance destroyed successfully.
Jul 31 12:21:35 user nova-compute[72447]: DEBUG nova.objects.instance [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'resources' on Instance uuid e75d2046-19d7-46b8-9c63-5af205c87c08 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1639847318',display_name='tempest-TestMinimumBasicScenario-server-1639847318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1639847318',id=18,image_ref='c50de5cc-8b81-4552-a892-a8a60da6e3ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByc5+TYn0U9H18DTmmjCJIFBIkeEbJS4pya3RhJF5gO675iLeoBkMf6n1Bo415YPpSYsW3OKsfLEylBcx7ws9w5x+4Xov1Sp4zSG+cejgKWA/ew9wHMEi+FSgcvY5Lggg==',key_name='tempest-TestMinimumBasicScenario-182857311',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:16:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c212a5254bcc4de290ec4bfbf8fbbd4b',ramdisk_id='',reservation_id='r-p5cjl6yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c50de5cc-8b81-4552-a892-a8a60da6e3ac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1422809681',owner_user_name='tempest-TestMinimumBasicScenario-1422809681-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:18:52Z,user_data=None,user_id='a40e5176e01443a085c01fc677cc8ca9',uuid=e75d2046-19d7-46b8-9c63-5af205c87c08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converting VIF {"id": "c491e329-e20e-47e6-893a-7643968aba7e", "address": "fa:16:3e:9a:97:2f", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc491e329-e2", "ovs_interfaceid": "c491e329-e20e-47e6-893a-7643968aba7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG os_vif [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc491e329-e2, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:35 user nova-compute[72447]: INFO os_vif [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:97:2f,bridge_name='br-int',has_traffic_filtering=True,id=c491e329-e20e-47e6-893a-7643968aba7e,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc491e329-e2')
Jul 31 12:21:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Deleting instance files /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08_del
Jul 31 12:21:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Deletion of /opt/stack/data/nova/instances/e75d2046-19d7-46b8-9c63-5af205c87c08_del complete
Jul 31 12:21:35 user nova-compute[72447]: INFO nova.compute.manager [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Took 1.61 seconds to destroy the instance on the hypervisor.
Jul 31 12:21:35 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-bb637900-f6ab-4ab7-b478-bb5a1bb4fbb0 req-f636a2c3-6406-433b-a10c-5fd8c9e0a636 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bb637900-f6ab-4ab7-b478-bb5a1bb4fbb0 req-f636a2c3-6406-433b-a10c-5fd8c9e0a636 service nova] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bb637900-f6ab-4ab7-b478-bb5a1bb4fbb0 req-f636a2c3-6406-433b-a10c-5fd8c9e0a636 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bb637900-f6ab-4ab7-b478-bb5a1bb4fbb0 req-f636a2c3-6406-433b-a10c-5fd8c9e0a636 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-bb637900-f6ab-4ab7-b478-bb5a1bb4fbb0 req-f636a2c3-6406-433b-a10c-5fd8c9e0a636 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] No waiting events found dispatching network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:36 user nova-compute[72447]: WARNING nova.compute.manager [req-bb637900-f6ab-4ab7-b478-bb5a1bb4fbb0 req-f636a2c3-6406-433b-a10c-5fd8c9e0a636 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received unexpected event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 for instance with vm_state active and task_state rescuing.
Jul 31 12:21:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-bb637900-f6ab-4ab7-b478-bb5a1bb4fbb0 req-f636a2c3-6406-433b-a10c-5fd8c9e0a636 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bb637900-f6ab-4ab7-b478-bb5a1bb4fbb0 req-f636a2c3-6406-433b-a10c-5fd8c9e0a636 service nova] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bb637900-f6ab-4ab7-b478-bb5a1bb4fbb0 req-f636a2c3-6406-433b-a10c-5fd8c9e0a636 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bb637900-f6ab-4ab7-b478-bb5a1bb4fbb0 req-f636a2c3-6406-433b-a10c-5fd8c9e0a636 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-bb637900-f6ab-4ab7-b478-bb5a1bb4fbb0 req-f636a2c3-6406-433b-a10c-5fd8c9e0a636 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] No waiting events found dispatching network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:36 user nova-compute[72447]: WARNING nova.compute.manager [req-bb637900-f6ab-4ab7-b478-bb5a1bb4fbb0 req-f636a2c3-6406-433b-a10c-5fd8c9e0a636 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received unexpected event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 for instance with vm_state active and task_state rescuing.
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG nova.compute.manager [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:21:36 user nova-compute[72447]: INFO nova.compute.claims [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Claim successful on node user
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG nova.compute.manager [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-79293171-5f65-4793-a498-2434054fbbdc req-6bf37038-b08a-4bb6-84b4-489e6db48333 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-79293171-5f65-4793-a498-2434054fbbdc req-6bf37038-b08a-4bb6-84b4-489e6db48333 service nova] Acquiring lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-79293171-5f65-4793-a498-2434054fbbdc req-6bf37038-b08a-4bb6-84b4-489e6db48333 service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-79293171-5f65-4793-a498-2434054fbbdc req-6bf37038-b08a-4bb6-84b4-489e6db48333 service nova] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-79293171-5f65-4793-a498-2434054fbbdc req-6bf37038-b08a-4bb6-84b4-489e6db48333 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] No waiting events found dispatching network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:36 user nova-compute[72447]: WARNING nova.compute.manager [req-79293171-5f65-4793-a498-2434054fbbdc req-6bf37038-b08a-4bb6-84b4-489e6db48333 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received unexpected event network-vif-plugged-c491e329-e20e-47e6-893a-7643968aba7e for instance with vm_state active and task_state deleting.
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:21:37 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Took 1.77 seconds to deallocate network for instance.
Jul 31 12:21:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.923s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c5ba3849-927a-4a2b-868a-96c2afc5981c tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 483f6f7a-c61d-46dd-893b-29b80da3f54d due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806097.6070187, 483f6f7a-c61d-46dd-893b-29b80da3f54d => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:21:37 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] VM Resumed (Lifecycle Event)
Jul 31 12:21:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.774s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:21:37 user nova-compute[72447]: INFO nova.compute.claims [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Claim successful on node user
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "2f98bc8b-537a-4b34-85ce-d7baac240046" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:37 user nova-compute[72447]: INFO nova.compute.manager [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Terminating instance
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.network.neutron [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:21:37 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806097.608428, 483f6f7a-c61d-46dd-893b-29b80da3f54d => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:21:37 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] VM Started (Lifecycle Event)
Jul 31 12:21:37 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.policy [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ead2fe8321b41be8bfc78f2bd5a036b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3110024c6d94eff885a84c59a01a85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:21:37 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Creating image(s)
Jul 31 12:21:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "/opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "/opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.192s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.172s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk 1073741824" returned: 0 in 0.068s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-d99d936d-0477-4853-8ad2-7df9ba36ecb5 req-4920233b-4884-418f-ae3b-95ab496b19be service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Received event network-vif-unplugged-ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d99d936d-0477-4853-8ad2-7df9ba36ecb5 req-4920233b-4884-418f-ae3b-95ab496b19be service nova] Acquiring lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d99d936d-0477-4853-8ad2-7df9ba36ecb5 req-4920233b-4884-418f-ae3b-95ab496b19be service nova] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d99d936d-0477-4853-8ad2-7df9ba36ecb5 req-4920233b-4884-418f-ae3b-95ab496b19be service nova] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-d99d936d-0477-4853-8ad2-7df9ba36ecb5 req-4920233b-4884-418f-ae3b-95ab496b19be service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] No waiting events found dispatching network-vif-unplugged-ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-d99d936d-0477-4853-8ad2-7df9ba36ecb5 req-4920233b-4884-418f-ae3b-95ab496b19be service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Received event network-vif-unplugged-ba08be19-41fe-4c05-8b70-b0b7a72760d2 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-d99d936d-0477-4853-8ad2-7df9ba36ecb5 req-4920233b-4884-418f-ae3b-95ab496b19be service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Received event network-vif-plugged-ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d99d936d-0477-4853-8ad2-7df9ba36ecb5 req-4920233b-4884-418f-ae3b-95ab496b19be service nova] Acquiring lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d99d936d-0477-4853-8ad2-7df9ba36ecb5 req-4920233b-4884-418f-ae3b-95ab496b19be service nova] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d99d936d-0477-4853-8ad2-7df9ba36ecb5 req-4920233b-4884-418f-ae3b-95ab496b19be service nova] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-d99d936d-0477-4853-8ad2-7df9ba36ecb5 req-4920233b-4884-418f-ae3b-95ab496b19be service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] No waiting events found dispatching network-vif-plugged-ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:38 user nova-compute[72447]: WARNING nova.compute.manager [req-d99d936d-0477-4853-8ad2-7df9ba36ecb5 req-4920233b-4884-418f-ae3b-95ab496b19be service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Received unexpected event network-vif-plugged-ba08be19-41fe-4c05-8b70-b0b7a72760d2 for instance with vm_state active and task_state deleting.
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.892s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.290s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Instance destroyed successfully.
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.objects.instance [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lazy-loading 'resources' on Instance uuid 2f98bc8b-537a-4b34-85ce-d7baac240046 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1809925763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1809925763',id=14,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs4w0d4M93O7HvFdCBFSNh6TCO6tKxxB39i+zx8AUMmhlsq736whk78TZS3wSeN4BOZU+/jx3ptUFkkipQu2dNk2OyJ5AoXdiQTEUSp9g4fvSyJ4EtilATHuuSom8hCcQ==',key_name='tempest-keypair-2092305748',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:15:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fefc91464b24c68a6d7f9059ec58b5f',ramdisk_id='',reservation_id='r-cv2isjq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1359270950',owner_user_name='tempest-ServerActionsV293TestJSON-1359270950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855a22b65634f1690901a5f9be8e885',uuid=2f98bc8b-537a-4b34-85ce-d7baac240046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "address": "fa:16:3e:41:f6:dd", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba08be19-41", "ovs_interfaceid": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converting VIF {"id": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "address": "fa:16:3e:41:f6:dd", "network": {"id": "af4f67d4-008b-40ec-bd0e-2e4603050cb0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1954082792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fefc91464b24c68a6d7f9059ec58b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba08be19-41", "ovs_interfaceid": "ba08be19-41fe-4c05-8b70-b0b7a72760d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba08be19-41fe-4c05-8b70-b0b7a72760d2,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba08be19-41') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG os_vif [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba08be19-41fe-4c05-8b70-b0b7a72760d2,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba08be19-41') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba08be19-41, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.187s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.network.neutron [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:21:38 user nova-compute[72447]: INFO os_vif [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba08be19-41fe-4c05-8b70-b0b7a72760d2,network=Network(af4f67d4-008b-40ec-bd0e-2e4603050cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba08be19-41')
Jul 31 12:21:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Deleting instance files /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046_del
Jul 31 12:21:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Deletion of /opt/stack/data/nova/instances/2f98bc8b-537a-4b34-85ce-d7baac240046_del complete
Jul 31 12:21:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Cannot resize image /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.objects.instance [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lazy-loading 'migration_context' on Instance uuid fbcc2c79-e1c7-45bc-9d16-db05b1027732 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Ensure instance console log exists: /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:38 user nova-compute[72447]: INFO nova.compute.manager [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.policy [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a7feffde0f74f63a6bd027c1958aacb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fad40b5f5e54e7ab9c6f8e78ceb3947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:21:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Creating image(s)
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "/opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "/opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-ea564576-a0dc-40f9-8d73-ef574ba1ec71 req-0dea223f-b76c-49f9-8202-d03bdfde1c58 service nova] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Received event network-vif-deleted-c491e329-e20e-47e6-893a-7643968aba7e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG nova.network.neutron [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Successfully created port: d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.161s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.159s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.819s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk 1073741824" returned: 0 in 0.076s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:39 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Deleted allocations for instance e75d2046-19d7-46b8-9c63-5af205c87c08
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.173s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-febd7a44-50a6-4bac-aba2-548cc67eac1e tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "e75d2046-19d7-46b8-9c63-5af205c87c08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.813s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Cannot resize image /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG nova.objects.instance [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'migration_context' on Instance uuid 8b487325-3b50-4f3f-857c-62fd0a64a6c0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Ensure instance console log exists: /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:21:40 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Took 1.32 seconds to deallocate network for instance.
Jul 31 12:21:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG nova.network.neutron [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Successfully created port: ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG nova.network.neutron [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Successfully updated port: d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG nova.compute.manager [req-f8da9a15-c274-430d-b73e-b1b3db8a6197 req-4796ef7a-b155-4d2c-938f-a8fd78220d48 service nova] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Received event network-vif-deleted-ba08be19-41fe-4c05-8b70-b0b7a72760d2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "refresh_cache-fbcc2c79-e1c7-45bc-9d16-db05b1027732" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquired lock "refresh_cache-fbcc2c79-e1c7-45bc-9d16-db05b1027732" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG nova.network.neutron [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG nova.network.neutron [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.597s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:40 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Deleted allocations for instance 2f98bc8b-537a-4b34-85ce-d7baac240046
Jul 31 12:21:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-933597db-d2da-4431-9703-caf2555bf6d1 tempest-ServerActionsV293TestJSON-1359270950 tempest-ServerActionsV293TestJSON-1359270950-project-member] Lock "2f98bc8b-537a-4b34-85ce-d7baac240046" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.290s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG nova.compute.manager [req-e9924b4f-dbfe-4442-b6c1-9a1409441177 req-1be1e6e3-9ee3-409a-b3d5-4b61c43dae04 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Received event network-changed-d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG nova.compute.manager [req-e9924b4f-dbfe-4442-b6c1-9a1409441177 req-1be1e6e3-9ee3-409a-b3d5-4b61c43dae04 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Refreshing instance network info cache due to event network-changed-d8a152be-ed59-426b-809c-cf7c2992844c. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:21:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e9924b4f-dbfe-4442-b6c1-9a1409441177 req-1be1e6e3-9ee3-409a-b3d5-4b61c43dae04 service nova] Acquiring lock "refresh_cache-fbcc2c79-e1c7-45bc-9d16-db05b1027732" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.network.neutron [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Updating instance_info_cache with network_info: [{"id": "d8a152be-ed59-426b-809c-cf7c2992844c", "address": "fa:16:3e:6e:6e:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a152be-ed", "ovs_interfaceid": "d8a152be-ed59-426b-809c-cf7c2992844c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Releasing lock "refresh_cache-fbcc2c79-e1c7-45bc-9d16-db05b1027732" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.compute.manager [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Instance network_info: |[{"id": "d8a152be-ed59-426b-809c-cf7c2992844c", "address": "fa:16:3e:6e:6e:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a152be-ed", "ovs_interfaceid": "d8a152be-ed59-426b-809c-cf7c2992844c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e9924b4f-dbfe-4442-b6c1-9a1409441177 req-1be1e6e3-9ee3-409a-b3d5-4b61c43dae04 service nova] Acquired lock "refresh_cache-fbcc2c79-e1c7-45bc-9d16-db05b1027732" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.network.neutron [req-e9924b4f-dbfe-4442-b6c1-9a1409441177 req-1be1e6e3-9ee3-409a-b3d5-4b61c43dae04 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Refreshing network info cache for port d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Start _get_guest_xml network_info=[{"id": "d8a152be-ed59-426b-809c-cf7c2992844c", "address": "fa:16:3e:6e:6e:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a152be-ed", "ovs_interfaceid": "d8a152be-ed59-426b-809c-cf7c2992844c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:21:41 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:21:41 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1220080915',display_name='tempest-VolumesAdminNegativeTest-server-1220080915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1220080915',id=27,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3110024c6d94eff885a84c59a01a85c',ramdisk_id='',reservation_id='r-3zdxb812',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-420445056',owner_user_name='tempest-VolumesAdminNegativeTest-420445056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:21:38Z,user_data=None,user_id='1ead2fe8321b41be8bfc78f2bd5a036b',uuid=fbcc2c79-e1c7-45bc-9d16-db05b1027732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8a152be-ed59-426b-809c-cf7c2992844c", "address": "fa:16:3e:6e:6e:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a152be-ed", "ovs_interfaceid": "d8a152be-ed59-426b-809c-cf7c2992844c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Converting VIF {"id": "d8a152be-ed59-426b-809c-cf7c2992844c", "address": "fa:16:3e:6e:6e:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a152be-ed", "ovs_interfaceid": "d8a152be-ed59-426b-809c-cf7c2992844c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6e:27,bridge_name='br-int',has_traffic_filtering=True,id=d8a152be-ed59-426b-809c-cf7c2992844c,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a152be-ed') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.objects.instance [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lazy-loading 'pci_devices' on Instance uuid fbcc2c79-e1c7-45bc-9d16-db05b1027732 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:21:41 user nova-compute[72447]:   <uuid>fbcc2c79-e1c7-45bc-9d16-db05b1027732</uuid>
Jul 31 12:21:41 user nova-compute[72447]:   <name>instance-0000001b</name>
Jul 31 12:21:41 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:21:41 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:21:41 user nova-compute[72447]:   <metadata>
Jul 31 12:21:41 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:21:41 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:21:41 user nova-compute[72447]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1220080915</nova:name>
Jul 31 12:21:41 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:21:41</nova:creationTime>
Jul 31 12:21:41 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:21:41 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:21:41 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:21:41 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:21:41 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:21:41 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:21:41 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:21:41 user nova-compute[72447]:       <nova:owner>
Jul 31 12:21:41 user nova-compute[72447]:         <nova:user uuid="1ead2fe8321b41be8bfc78f2bd5a036b">tempest-VolumesAdminNegativeTest-420445056-project-member</nova:user>
Jul 31 12:21:41 user nova-compute[72447]:         <nova:project uuid="e3110024c6d94eff885a84c59a01a85c">tempest-VolumesAdminNegativeTest-420445056</nova:project>
Jul 31 12:21:41 user nova-compute[72447]:       </nova:owner>
Jul 31 12:21:41 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:21:41 user nova-compute[72447]:       <nova:ports>
Jul 31 12:21:41 user nova-compute[72447]:         <nova:port uuid="d8a152be-ed59-426b-809c-cf7c2992844c">
Jul 31 12:21:41 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 12:21:41 user nova-compute[72447]:         </nova:port>
Jul 31 12:21:41 user nova-compute[72447]:       </nova:ports>
Jul 31 12:21:41 user nova-compute[72447]:     </nova:instance>
Jul 31 12:21:41 user nova-compute[72447]:   </metadata>
Jul 31 12:21:41 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:21:41 user nova-compute[72447]:     <system>
Jul 31 12:21:41 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:21:41 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:21:41 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:21:41 user nova-compute[72447]:       <entry name="serial">fbcc2c79-e1c7-45bc-9d16-db05b1027732</entry>
Jul 31 12:21:41 user nova-compute[72447]:       <entry name="uuid">fbcc2c79-e1c7-45bc-9d16-db05b1027732</entry>
Jul 31 12:21:41 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:21:41 user nova-compute[72447]:     </system>
Jul 31 12:21:41 user nova-compute[72447]:   </sysinfo>
Jul 31 12:21:41 user nova-compute[72447]:   <os>
Jul 31 12:21:41 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:21:41 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:21:41 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:21:41 user nova-compute[72447]:   </os>
Jul 31 12:21:41 user nova-compute[72447]:   <features>
Jul 31 12:21:41 user nova-compute[72447]:     <acpi/>
Jul 31 12:21:41 user nova-compute[72447]:     <apic/>
Jul 31 12:21:41 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:21:41 user nova-compute[72447]:   </features>
Jul 31 12:21:41 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:21:41 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:21:41 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:21:41 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:21:41 user nova-compute[72447]:   </clock>
Jul 31 12:21:41 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:21:41 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:21:41 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:21:41 user nova-compute[72447]:   </cpu>
Jul 31 12:21:41 user nova-compute[72447]:   <devices>
Jul 31 12:21:41 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:21:41 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:21:41 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk"/>
Jul 31 12:21:41 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:21:41 user nova-compute[72447]:     </disk>
Jul 31 12:21:41 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:21:41 user nova-compute[72447]:       <mac address="fa:16:3e:6e:6e:27"/>
Jul 31 12:21:41 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:21:41 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:21:41 user nova-compute[72447]:       <target dev="tapd8a152be-ed"/>
Jul 31 12:21:41 user nova-compute[72447]:     </interface>
Jul 31 12:21:41 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:21:41 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/console.log" append="off"/>
Jul 31 12:21:41 user nova-compute[72447]:     </serial>
Jul 31 12:21:41 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:21:41 user nova-compute[72447]:     <video>
Jul 31 12:21:41 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:21:41 user nova-compute[72447]:     </video>
Jul 31 12:21:41 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:21:41 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:21:41 user nova-compute[72447]:     </rng>
Jul 31 12:21:41 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:21:41 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:21:41 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:21:41 user nova-compute[72447]:     </memballoon>
Jul 31 12:21:41 user nova-compute[72447]:   </devices>
Jul 31 12:21:41 user nova-compute[72447]: </domain>
Jul 31 12:21:41 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1220080915',display_name='tempest-VolumesAdminNegativeTest-server-1220080915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1220080915',id=27,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3110024c6d94eff885a84c59a01a85c',ramdisk_id='',reservation_id='r-3zdxb812',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-420445056',owner_user_name='tempest-VolumesAdminNegativeTest-420445056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:21:38Z,user_data=None,user_id='1ead2fe8321b41be8bfc78f2bd5a036b',uuid=fbcc2c79-e1c7-45bc-9d16-db05b1027732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8a152be-ed59-426b-809c-cf7c2992844c", "address": "fa:16:3e:6e:6e:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a152be-ed", "ovs_interfaceid": "d8a152be-ed59-426b-809c-cf7c2992844c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Converting VIF {"id": "d8a152be-ed59-426b-809c-cf7c2992844c", "address": "fa:16:3e:6e:6e:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a152be-ed", "ovs_interfaceid": "d8a152be-ed59-426b-809c-cf7c2992844c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6e:27,bridge_name='br-int',has_traffic_filtering=True,id=d8a152be-ed59-426b-809c-cf7c2992844c,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a152be-ed') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG os_vif [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6e:27,bridge_name='br-int',has_traffic_filtering=True,id=d8a152be-ed59-426b-809c-cf7c2992844c,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a152be-ed') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8a152be-ed, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8a152be-ed, col_values=(('external_ids', {'iface-id': 'd8a152be-ed59-426b-809c-cf7c2992844c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:6e:27', 'vm-uuid': 'fbcc2c79-e1c7-45bc-9d16-db05b1027732'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:41 user nova-compute[72447]: INFO os_vif [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6e:27,bridge_name='br-int',has_traffic_filtering=True,id=d8a152be-ed59-426b-809c-cf7c2992844c,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a152be-ed')
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] No VIF found with MAC fa:16:3e:6e:6e:27, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.network.neutron [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Successfully updated port: ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "refresh_cache-8b487325-3b50-4f3f-857c-62fd0a64a6c0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquired lock "refresh_cache-8b487325-3b50-4f3f-857c-62fd0a64a6c0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.network.neutron [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:21:41 user nova-compute[72447]: DEBUG nova.network.neutron [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.network.neutron [req-e9924b4f-dbfe-4442-b6c1-9a1409441177 req-1be1e6e3-9ee3-409a-b3d5-4b61c43dae04 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Updated VIF entry in instance network info cache for port d8a152be-ed59-426b-809c-cf7c2992844c. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.network.neutron [req-e9924b4f-dbfe-4442-b6c1-9a1409441177 req-1be1e6e3-9ee3-409a-b3d5-4b61c43dae04 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Updating instance_info_cache with network_info: [{"id": "d8a152be-ed59-426b-809c-cf7c2992844c", "address": "fa:16:3e:6e:6e:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a152be-ed", "ovs_interfaceid": "d8a152be-ed59-426b-809c-cf7c2992844c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e9924b4f-dbfe-4442-b6c1-9a1409441177 req-1be1e6e3-9ee3-409a-b3d5-4b61c43dae04 service nova] Releasing lock "refresh_cache-fbcc2c79-e1c7-45bc-9d16-db05b1027732" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.network.neutron [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Updating instance_info_cache with network_info: [{"id": "ab22b558-2e8f-481d-8c03-8d1294acd404", "address": "fa:16:3e:34:09:9c", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab22b558-2e", "ovs_interfaceid": "ab22b558-2e8f-481d-8c03-8d1294acd404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Releasing lock "refresh_cache-8b487325-3b50-4f3f-857c-62fd0a64a6c0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Instance network_info: |[{"id": "ab22b558-2e8f-481d-8c03-8d1294acd404", "address": "fa:16:3e:34:09:9c", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab22b558-2e", "ovs_interfaceid": "ab22b558-2e8f-481d-8c03-8d1294acd404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Start _get_guest_xml network_info=[{"id": "ab22b558-2e8f-481d-8c03-8d1294acd404", "address": "fa:16:3e:34:09:9c", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab22b558-2e", "ovs_interfaceid": "ab22b558-2e8f-481d-8c03-8d1294acd404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:21:42 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:21:42 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-900187126',display_name='tempest-AttachVolumeNegativeTest-server-900187126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-900187126',id=28,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7vgDS+OSC+NByKp+mnYtgC5tV0dnsNl5qtVizb1f0VCROPbFBZAGjilQJhzp1H7IRmmruz9Okx5k2fF30H1BhQNWK5EC9Cx5V6ngthUPnXoC6XOQxHuSbFfOptbL33AQ==',key_name='tempest-keypair-756466582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fad40b5f5e54e7ab9c6f8e78ceb3947',ramdisk_id='',reservation_id='r-bfqxpxz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323727931',owner_user_name='tempest-AttachVolumeNegativeTest-323727931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:21:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a7feffde0f74f63a6bd027c1958aacb',uuid=8b487325-3b50-4f3f-857c-62fd0a64a6c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab22b558-2e8f-481d-8c03-8d1294acd404", "address": "fa:16:3e:34:09:9c", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab22b558-2e", "ovs_interfaceid": "ab22b558-2e8f-481d-8c03-8d1294acd404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converting VIF {"id": "ab22b558-2e8f-481d-8c03-8d1294acd404", "address": "fa:16:3e:34:09:9c", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab22b558-2e", "ovs_interfaceid": "ab22b558-2e8f-481d-8c03-8d1294acd404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:09:9c,bridge_name='br-int',has_traffic_filtering=True,id=ab22b558-2e8f-481d-8c03-8d1294acd404,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab22b558-2e') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.objects.instance [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b487325-3b50-4f3f-857c-62fd0a64a6c0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:21:42 user nova-compute[72447]:   <uuid>8b487325-3b50-4f3f-857c-62fd0a64a6c0</uuid>
Jul 31 12:21:42 user nova-compute[72447]:   <name>instance-0000001c</name>
Jul 31 12:21:42 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:21:42 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:21:42 user nova-compute[72447]:   <metadata>
Jul 31 12:21:42 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:21:42 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:21:42 user nova-compute[72447]:       <nova:name>tempest-AttachVolumeNegativeTest-server-900187126</nova:name>
Jul 31 12:21:42 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:21:42</nova:creationTime>
Jul 31 12:21:42 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:21:42 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:21:42 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:21:42 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:21:42 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:21:42 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:21:42 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:21:42 user nova-compute[72447]:       <nova:owner>
Jul 31 12:21:42 user nova-compute[72447]:         <nova:user uuid="6a7feffde0f74f63a6bd027c1958aacb">tempest-AttachVolumeNegativeTest-323727931-project-member</nova:user>
Jul 31 12:21:42 user nova-compute[72447]:         <nova:project uuid="7fad40b5f5e54e7ab9c6f8e78ceb3947">tempest-AttachVolumeNegativeTest-323727931</nova:project>
Jul 31 12:21:42 user nova-compute[72447]:       </nova:owner>
Jul 31 12:21:42 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:21:42 user nova-compute[72447]:       <nova:ports>
Jul 31 12:21:42 user nova-compute[72447]:         <nova:port uuid="ab22b558-2e8f-481d-8c03-8d1294acd404">
Jul 31 12:21:42 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 12:21:42 user nova-compute[72447]:         </nova:port>
Jul 31 12:21:42 user nova-compute[72447]:       </nova:ports>
Jul 31 12:21:42 user nova-compute[72447]:     </nova:instance>
Jul 31 12:21:42 user nova-compute[72447]:   </metadata>
Jul 31 12:21:42 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:21:42 user nova-compute[72447]:     <system>
Jul 31 12:21:42 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:21:42 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:21:42 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:21:42 user nova-compute[72447]:       <entry name="serial">8b487325-3b50-4f3f-857c-62fd0a64a6c0</entry>
Jul 31 12:21:42 user nova-compute[72447]:       <entry name="uuid">8b487325-3b50-4f3f-857c-62fd0a64a6c0</entry>
Jul 31 12:21:42 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:21:42 user nova-compute[72447]:     </system>
Jul 31 12:21:42 user nova-compute[72447]:   </sysinfo>
Jul 31 12:21:42 user nova-compute[72447]:   <os>
Jul 31 12:21:42 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:21:42 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:21:42 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:21:42 user nova-compute[72447]:   </os>
Jul 31 12:21:42 user nova-compute[72447]:   <features>
Jul 31 12:21:42 user nova-compute[72447]:     <acpi/>
Jul 31 12:21:42 user nova-compute[72447]:     <apic/>
Jul 31 12:21:42 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:21:42 user nova-compute[72447]:   </features>
Jul 31 12:21:42 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:21:42 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:21:42 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:21:42 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:21:42 user nova-compute[72447]:   </clock>
Jul 31 12:21:42 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:21:42 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:21:42 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:21:42 user nova-compute[72447]:   </cpu>
Jul 31 12:21:42 user nova-compute[72447]:   <devices>
Jul 31 12:21:42 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:21:42 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:21:42 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk"/>
Jul 31 12:21:42 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:21:42 user nova-compute[72447]:     </disk>
Jul 31 12:21:42 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:21:42 user nova-compute[72447]:       <mac address="fa:16:3e:34:09:9c"/>
Jul 31 12:21:42 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:21:42 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:21:42 user nova-compute[72447]:       <target dev="tapab22b558-2e"/>
Jul 31 12:21:42 user nova-compute[72447]:     </interface>
Jul 31 12:21:42 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:21:42 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/console.log" append="off"/>
Jul 31 12:21:42 user nova-compute[72447]:     </serial>
Jul 31 12:21:42 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:21:42 user nova-compute[72447]:     <video>
Jul 31 12:21:42 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:21:42 user nova-compute[72447]:     </video>
Jul 31 12:21:42 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:21:42 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:21:42 user nova-compute[72447]:     </rng>
Jul 31 12:21:42 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:21:42 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:21:42 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:21:42 user nova-compute[72447]:     </memballoon>
Jul 31 12:21:42 user nova-compute[72447]:   </devices>
Jul 31 12:21:42 user nova-compute[72447]: </domain>
Jul 31 12:21:42 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-900187126',display_name='tempest-AttachVolumeNegativeTest-server-900187126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-900187126',id=28,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7vgDS+OSC+NByKp+mnYtgC5tV0dnsNl5qtVizb1f0VCROPbFBZAGjilQJhzp1H7IRmmruz9Okx5k2fF30H1BhQNWK5EC9Cx5V6ngthUPnXoC6XOQxHuSbFfOptbL33AQ==',key_name='tempest-keypair-756466582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fad40b5f5e54e7ab9c6f8e78ceb3947',ramdisk_id='',reservation_id='r-bfqxpxz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323727931',owner_user_name='tempest-AttachVolumeNegativeTest-323727931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:21:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a7feffde0f74f63a6bd027c1958aacb',uuid=8b487325-3b50-4f3f-857c-62fd0a64a6c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab22b558-2e8f-481d-8c03-8d1294acd404", "address": "fa:16:3e:34:09:9c", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab22b558-2e", "ovs_interfaceid": "ab22b558-2e8f-481d-8c03-8d1294acd404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converting VIF {"id": "ab22b558-2e8f-481d-8c03-8d1294acd404", "address": "fa:16:3e:34:09:9c", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab22b558-2e", "ovs_interfaceid": "ab22b558-2e8f-481d-8c03-8d1294acd404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:09:9c,bridge_name='br-int',has_traffic_filtering=True,id=ab22b558-2e8f-481d-8c03-8d1294acd404,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab22b558-2e') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG os_vif [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:09:9c,bridge_name='br-int',has_traffic_filtering=True,id=ab22b558-2e8f-481d-8c03-8d1294acd404,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab22b558-2e') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab22b558-2e, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapab22b558-2e, col_values=(('external_ids', {'iface-id': 'ab22b558-2e8f-481d-8c03-8d1294acd404', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:09:9c', 'vm-uuid': '8b487325-3b50-4f3f-857c-62fd0a64a6c0'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:42 user nova-compute[72447]: INFO os_vif [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:09:9c,bridge_name='br-int',has_traffic_filtering=True,id=ab22b558-2e8f-481d-8c03-8d1294acd404,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab22b558-2e')
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No VIF found with MAC fa:16:3e:34:09:9c, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG nova.compute.manager [req-964d6e66-2fda-4362-b434-d33b2d29a8f7 req-45420770-2501-49ac-8f70-60313d6ad5d6 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Received event network-changed-ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG nova.compute.manager [req-964d6e66-2fda-4362-b434-d33b2d29a8f7 req-45420770-2501-49ac-8f70-60313d6ad5d6 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Refreshing instance network info cache due to event network-changed-ab22b558-2e8f-481d-8c03-8d1294acd404. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-964d6e66-2fda-4362-b434-d33b2d29a8f7 req-45420770-2501-49ac-8f70-60313d6ad5d6 service nova] Acquiring lock "refresh_cache-8b487325-3b50-4f3f-857c-62fd0a64a6c0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-964d6e66-2fda-4362-b434-d33b2d29a8f7 req-45420770-2501-49ac-8f70-60313d6ad5d6 service nova] Acquired lock "refresh_cache-8b487325-3b50-4f3f-857c-62fd0a64a6c0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG nova.network.neutron [req-964d6e66-2fda-4362-b434-d33b2d29a8f7 req-45420770-2501-49ac-8f70-60313d6ad5d6 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Refreshing network info cache for port ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG nova.compute.manager [req-47dcdf10-b2d7-4aea-ace3-f89ac82eeb0e req-da6593c7-7529-48ac-8268-cfde2ea2c68b service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Received event network-vif-plugged-d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-47dcdf10-b2d7-4aea-ace3-f89ac82eeb0e req-da6593c7-7529-48ac-8268-cfde2ea2c68b service nova] Acquiring lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-47dcdf10-b2d7-4aea-ace3-f89ac82eeb0e req-da6593c7-7529-48ac-8268-cfde2ea2c68b service nova] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-47dcdf10-b2d7-4aea-ace3-f89ac82eeb0e req-da6593c7-7529-48ac-8268-cfde2ea2c68b service nova] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG nova.compute.manager [req-47dcdf10-b2d7-4aea-ace3-f89ac82eeb0e req-da6593c7-7529-48ac-8268-cfde2ea2c68b service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] No waiting events found dispatching network-vif-plugged-d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:43 user nova-compute[72447]: WARNING nova.compute.manager [req-47dcdf10-b2d7-4aea-ace3-f89ac82eeb0e req-da6593c7-7529-48ac-8268-cfde2ea2c68b service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Received unexpected event network-vif-plugged-d8a152be-ed59-426b-809c-cf7c2992844c for instance with vm_state building and task_state spawning.
Jul 31 12:21:43 user nova-compute[72447]: DEBUG nova.network.neutron [req-964d6e66-2fda-4362-b434-d33b2d29a8f7 req-45420770-2501-49ac-8f70-60313d6ad5d6 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Updated VIF entry in instance network info cache for port ab22b558-2e8f-481d-8c03-8d1294acd404. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG nova.network.neutron [req-964d6e66-2fda-4362-b434-d33b2d29a8f7 req-45420770-2501-49ac-8f70-60313d6ad5d6 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Updating instance_info_cache with network_info: [{"id": "ab22b558-2e8f-481d-8c03-8d1294acd404", "address": "fa:16:3e:34:09:9c", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab22b558-2e", "ovs_interfaceid": "ab22b558-2e8f-481d-8c03-8d1294acd404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:21:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-964d6e66-2fda-4362-b434-d33b2d29a8f7 req-45420770-2501-49ac-8f70-60313d6ad5d6 service nova] Releasing lock "refresh_cache-8b487325-3b50-4f3f-857c-62fd0a64a6c0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:21:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Received event network-vif-plugged-d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] Acquiring lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] No waiting events found dispatching network-vif-plugged-d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:45 user nova-compute[72447]: WARNING nova.compute.manager [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Received unexpected event network-vif-plugged-d8a152be-ed59-426b-809c-cf7c2992844c for instance with vm_state building and task_state spawning.
Jul 31 12:21:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Received event network-vif-plugged-ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] Acquiring lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] No waiting events found dispatching network-vif-plugged-ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:45 user nova-compute[72447]: WARNING nova.compute.manager [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Received unexpected event network-vif-plugged-ab22b558-2e8f-481d-8c03-8d1294acd404 for instance with vm_state building and task_state spawning.
Jul 31 12:21:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Received event network-vif-plugged-ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] Acquiring lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] No waiting events found dispatching network-vif-plugged-ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:45 user nova-compute[72447]: WARNING nova.compute.manager [req-f2aae193-3c1d-435c-a2b0-d0442f4b0b27 req-b69649e8-2735-4f9b-b0b1-54750ee40fc2 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Received unexpected event network-vif-plugged-ab22b558-2e8f-481d-8c03-8d1294acd404 for instance with vm_state building and task_state spawning.
Jul 31 12:21:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806106.3159492, fbcc2c79-e1c7-45bc-9d16-db05b1027732 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:21:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] VM Resumed (Lifecycle Event)
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:21:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Instance spawned successfully.
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806106.3173237, fbcc2c79-e1c7-45bc-9d16-db05b1027732 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:21:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] VM Started (Lifecycle Event)
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:21:46 user nova-compute[72447]: INFO nova.compute.manager [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Took 8.48 seconds to spawn the instance on the hypervisor.
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:21:46 user nova-compute[72447]: INFO nova.compute.manager [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Took 9.90 seconds to build instance.
Jul 31 12:21:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af3cf0a5-ea04-4851-8246-561b2a286a90 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.010s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806106.889751, 8b487325-3b50-4f3f-857c-62fd0a64a6c0 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:21:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] VM Resumed (Lifecycle Event)
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:21:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Instance spawned successfully.
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:21:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806106.8963995, 8b487325-3b50-4f3f-857c-62fd0a64a6c0 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:21:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] VM Started (Lifecycle Event)
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:21:47 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:21:47 user nova-compute[72447]: INFO nova.compute.manager [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Took 8.08 seconds to spawn the instance on the hypervisor.
Jul 31 12:21:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:47 user nova-compute[72447]: INFO nova.compute.manager [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Took 10.27 seconds to build instance.
Jul 31 12:21:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-924223e0-2af1-4ad3-86fb-d9c9fd2c08cd tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.394s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:49 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:21:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:50 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806095.215065, e75d2046-19d7-46b8-9c63-5af205c87c08 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:21:50 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] VM Stopped (Lifecycle Event)
Jul 31 12:21:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3d164c04-420d-40e4-9501-7c4634bdcf23 None None] [instance: e75d2046-19d7-46b8-9c63-5af205c87c08] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:50 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:21:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:21:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:21:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:21:50 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:21:51 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating instance_info_cache with network_info: [{"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:21:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:21:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:21:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:53 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:21:53 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:21:53 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806098.4801855, 2f98bc8b-537a-4b34-85ce-d7baac240046 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:21:53 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] VM Stopped (Lifecycle Event)
Jul 31 12:21:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-af5b001d-9118-497e-be99-0da065132a9d None None] [instance: 2f98bc8b-537a-4b34-85ce-d7baac240046] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:21:54 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:21:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:55 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:21:55 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:21:55 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:21:55 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72447) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Port 8bf862f6-240f-47c4-bf1a-3cf399024ae2 binding to destination host user is already ACTIVE {{(pid=72447) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquired lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating instance_info_cache with network_info: [{"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Releasing lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Creating tmpfile /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/tmp67ui3npw to verify with other compute node that the instance is on the same shared storage. {{(pid=72447) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-4f65a35f-ccc0-44b0-a04d-18f2698b4b5f req-8af816ab-746d-416a-bcec-aa14005c65f4 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-unplugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4f65a35f-ccc0-44b0-a04d-18f2698b4b5f req-8af816ab-746d-416a-bcec-aa14005c65f4 service nova] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4f65a35f-ccc0-44b0-a04d-18f2698b4b5f req-8af816ab-746d-416a-bcec-aa14005c65f4 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4f65a35f-ccc0-44b0-a04d-18f2698b4b5f req-8af816ab-746d-416a-bcec-aa14005c65f4 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-4f65a35f-ccc0-44b0-a04d-18f2698b4b5f req-8af816ab-746d-416a-bcec-aa14005c65f4 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] No waiting events found dispatching network-vif-unplugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:57 user nova-compute[72447]: WARNING nova.compute.manager [req-4f65a35f-ccc0-44b0-a04d-18f2698b4b5f req-8af816ab-746d-416a-bcec-aa14005c65f4 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received unexpected event network-vif-unplugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 for instance with vm_state resized and task_state resize_reverting.
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Instance destroyed successfully.
Jul 31 12:21:57 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'resources' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-89958571',display_name='tempest-ServerActionsTestOtherB-server-89958571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-89958571',id=17,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+f+k0iUUuOhXlHDtikwFngFfrKZWO/pXd3lnR3i6FVV78yfGidAD1wnO5wJJhLxF9aq2IfkjSAFEQM+7NMJo1w081YcYQwauvTLFPqn5c5JoXRC/7+8j1JXyzJ3lUTfg==',key_name='tempest-keypair-1372814901',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:20:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cdf6c9123e14bf7aa1dc369852d1f06',ramdisk_id='',reservation_id='r-6pk3jb2b',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1175098759',owner_user_name='tempest-ServerActionsTestOtherB-1175098759-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:20:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='179d710ed6d3412bbfd665d30ccc6451',uuid=92ff498b-1337-47da-aaf1-b5fb9f19e98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converting VIF {"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_vif [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bf862f6-24, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:21:57 user nova-compute[72447]: INFO os_vif [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24')
Jul 31 12:21:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSZgmNxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:21:57 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3438432a-3e9c-4a46-b8d0-216cfae051e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bab44e8-27bb-44ba-a0ee-c0b9c40381a8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:21:57 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:21:57 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:21:57 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:21:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:21:57 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:21:57 user nova-compute[72447]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:21:57 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:21:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0648701a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'): ({'sdf'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Removing single pathed devices sdf {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e776b84-d9d7-4893-b3f5-85199e3a8ce7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f07213-f177-4c96-9645-dcbeec9586d6]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Flushing IO for device /dev/sdf {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4770118c-81bf-4c1d-858e-061bb91a2b67]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dddbc9d-8ee6-4a17-9fb8-7281f7e71488]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] SCSI volumes sdf have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4b8244-f7fe-4216-85c3-4cbf20cd6dc2]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[092fccb0-1151-476e-9535-9eff73b247c4]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260]
Jul 31 12:21:57 user nova-compute[72447]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260] successful.
Jul 31 12:21:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f694cedf-174c-4eca-9ddb-0c35b5cc06cc]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] <== disconnect_volume: return (399ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'migration_context' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-fff113f9-e49f-4927-a83e-f3cd9de3cdf6 req-0783e737-9646-4285-a99d-83c17cfd20f3 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fff113f9-e49f-4927-a83e-f3cd9de3cdf6 req-0783e737-9646-4285-a99d-83c17cfd20f3 service nova] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fff113f9-e49f-4927-a83e-f3cd9de3cdf6 req-0783e737-9646-4285-a99d-83c17cfd20f3 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fff113f9-e49f-4927-a83e-f3cd9de3cdf6 req-0783e737-9646-4285-a99d-83c17cfd20f3 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-fff113f9-e49f-4927-a83e-f3cd9de3cdf6 req-0783e737-9646-4285-a99d-83c17cfd20f3 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] No waiting events found dispatching network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:21:59 user nova-compute[72447]: WARNING nova.compute.manager [req-fff113f9-e49f-4927-a83e-f3cd9de3cdf6 req-0783e737-9646-4285-a99d-83c17cfd20f3 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received unexpected event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 for instance with vm_state resized and task_state resize_reverting.
Jul 31 12:21:59 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Refreshing inventories for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Updating ProviderTree inventory for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Refreshing aggregate associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, aggregates: None {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Refreshing trait associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:21:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.952s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:00 user nova-compute[72447]: INFO nova.compute.manager [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Swapping old allocation on dict_keys(['b4624c66-2a39-4376-bf09-7f8bf9b99fc6']) held by migration 1e8c9167-6f72-47da-b260-8c1b3375469d for instance
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Overwriting current allocation {'allocations': {'b4624c66-2a39-4376-bf09-7f8bf9b99fc6': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 33}}, 'project_id': '2cdf6c9123e14bf7aa1dc369852d1f06', 'user_id': '179d710ed6d3412bbfd665d30ccc6451', 'consumer_generation': 1} on consumer 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquired lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:01 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:22:01 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=6949MB free_disk=25.103363037109375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.network.neutron [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating instance_info_cache with network_info: [{"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Releasing lock "refresh_cache-92ff498b-1337-47da-aaf1-b5fb9f19e98d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG os_brick.utils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d88ae13-8794-4424-859e-cbb8abebbcb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b291ba57-9fdb-48f2-ac0c-45a108dda3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b5fe9835-8278-449e-9069-18421cb088dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 483f6f7a-c61d-46dd-893b-29b80da3f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 92ff498b-1337-47da-aaf1-b5fb9f19e98d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6958347e-bd3b-4f4a-ae78-c282d7849a57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance fbcc2c79-e1c7-45bc-9d16-db05b1027732 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 8b487325-3b50-4f3f-857c-62fd0a64a6c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae43834f-0227-45c6-94d4-9ae32b29a68f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa1c488-e54c-402a-bc8f-154b4b445842]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ece10b-422b-4f14-9ae8-2cbde605450b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:22:01 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[420bac05-3b8e-4ab6-8428-888e73bd3b20]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG os_brick.utils [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:22:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:22:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:22:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:22:04 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:22:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 12:22:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] There are 0 instances to clean {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 12:22:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Starting finish_revert_migration {{(pid=72447) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Start _get_guest_xml network_info=[{"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'f8241288-ed33-4460-a8ce-20ceb5c69d0c', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSZgmNxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '92ff498b-1337-47da-aaf1-b5fb9f19e98d', 'attached_at': '2023-07-31T12:22:09.000000', 'detached_at': '', 'volume_id': 'ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc', 'serial': 'ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'}, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:22:08 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:22:08 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'vcpu_model' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSZgmNxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:22:08 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:22:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:22:08 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:22:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:22:08 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:22:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e57d9c-5ec3-4642-8e02-373c5a957e95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:22:08 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:22:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aed68b-598b-4971-b0b6-922668169331]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc] added
Jul 31 12:22:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06cbff9-cb3c-432c-8a91-f1fd0df12d30]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6401581f-f308-46ae-a8a6-1513cffb81f3]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSZgmNxe {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSZgmNxe" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4f6593-baca-41f4-ab85-5b3dcee8b526]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kSZgmNxe'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fb5c63-351e-4a51-ae2e-e4419f26e7c8]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a125a35d-8004-46be-8e0d-249fc6dad01f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:22:09 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:22:09 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:22:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:22:09 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:22:09 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:22:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b184ce86-bf2b-41c2-8551-c13cd592c65d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260]
Jul 31 12:22:09 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260] successful.
Jul 31 12:22:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[375b88ce-939a-42b8-9311-d196aa78562e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[28528327-ab07-45e7-9482-c8bad7a0cedc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:22:09 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:22:09 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:22:09 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:22:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:22:09 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:22:09 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:22:09 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:22:09 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2d8ea3-5d5e-4d4c-9905-c64b9d1d123e]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSZgmNxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:22:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23561626661346564', 'path': '/dev/sdd'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561626661346564', 'path': '/dev/sdd'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-89958571',display_name='tempest-ServerActionsTestOtherB-server-89958571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-89958571',id=17,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+f+k0iUUuOhXlHDtikwFngFfrKZWO/pXd3lnR3i6FVV78yfGidAD1wnO5wJJhLxF9aq2IfkjSAFEQM+7NMJo1w081YcYQwauvTLFPqn5c5JoXRC/7+8j1JXyzJ3lUTfg==',key_name='tempest-keypair-1372814901',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:20:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2cdf6c9123e14bf7aa1dc369852d1f06',ramdisk_id='',reservation_id='r-6pk3jb2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1175098759',owner_user_name='tempest-ServerActionsTestOtherB-1175098759-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:21:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='179d710ed6d3412bbfd665d30ccc6451',uuid=92ff498b-1337-47da-aaf1-b5fb9f19e98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converting VIF {"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:22:10 user nova-compute[72447]:   <uuid>92ff498b-1337-47da-aaf1-b5fb9f19e98d</uuid>
Jul 31 12:22:10 user nova-compute[72447]:   <name>instance-00000011</name>
Jul 31 12:22:10 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:22:10 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:22:10 user nova-compute[72447]:   <metadata>
Jul 31 12:22:10 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:22:10 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:22:10 user nova-compute[72447]:       <nova:name>tempest-ServerActionsTestOtherB-server-89958571</nova:name>
Jul 31 12:22:10 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:22:08</nova:creationTime>
Jul 31 12:22:10 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:22:10 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:22:10 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:22:10 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:22:10 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:22:10 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:22:10 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:22:10 user nova-compute[72447]:       <nova:owner>
Jul 31 12:22:10 user nova-compute[72447]:         <nova:user uuid="179d710ed6d3412bbfd665d30ccc6451">tempest-ServerActionsTestOtherB-1175098759-project-member</nova:user>
Jul 31 12:22:10 user nova-compute[72447]:         <nova:project uuid="2cdf6c9123e14bf7aa1dc369852d1f06">tempest-ServerActionsTestOtherB-1175098759</nova:project>
Jul 31 12:22:10 user nova-compute[72447]:       </nova:owner>
Jul 31 12:22:10 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:22:10 user nova-compute[72447]:       <nova:ports>
Jul 31 12:22:10 user nova-compute[72447]:         <nova:port uuid="8bf862f6-240f-47c4-bf1a-3cf399024ae2">
Jul 31 12:22:10 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 12:22:10 user nova-compute[72447]:         </nova:port>
Jul 31 12:22:10 user nova-compute[72447]:       </nova:ports>
Jul 31 12:22:10 user nova-compute[72447]:     </nova:instance>
Jul 31 12:22:10 user nova-compute[72447]:   </metadata>
Jul 31 12:22:10 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:22:10 user nova-compute[72447]:     <system>
Jul 31 12:22:10 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:22:10 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:22:10 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:22:10 user nova-compute[72447]:       <entry name="serial">92ff498b-1337-47da-aaf1-b5fb9f19e98d</entry>
Jul 31 12:22:10 user nova-compute[72447]:       <entry name="uuid">92ff498b-1337-47da-aaf1-b5fb9f19e98d</entry>
Jul 31 12:22:10 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:22:10 user nova-compute[72447]:     </system>
Jul 31 12:22:10 user nova-compute[72447]:   </sysinfo>
Jul 31 12:22:10 user nova-compute[72447]:   <os>
Jul 31 12:22:10 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:22:10 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:22:10 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:22:10 user nova-compute[72447]:   </os>
Jul 31 12:22:10 user nova-compute[72447]:   <features>
Jul 31 12:22:10 user nova-compute[72447]:     <acpi/>
Jul 31 12:22:10 user nova-compute[72447]:     <apic/>
Jul 31 12:22:10 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:22:10 user nova-compute[72447]:   </features>
Jul 31 12:22:10 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:22:10 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:22:10 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:22:10 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:22:10 user nova-compute[72447]:   </clock>
Jul 31 12:22:10 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:22:10 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:22:10 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:22:10 user nova-compute[72447]:   </cpu>
Jul 31 12:22:10 user nova-compute[72447]:   <devices>
Jul 31 12:22:10 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:22:10 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:22:10 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk"/>
Jul 31 12:22:10 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:22:10 user nova-compute[72447]:     </disk>
Jul 31 12:22:10 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:22:10 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:22:10 user nova-compute[72447]:       <source dev="/dev/sdd"/>
Jul 31 12:22:10 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:22:10 user nova-compute[72447]:       <serial>ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc</serial>
Jul 31 12:22:10 user nova-compute[72447]:     </disk>
Jul 31 12:22:10 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:22:10 user nova-compute[72447]:       <mac address="fa:16:3e:f8:df:6b"/>
Jul 31 12:22:10 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:22:10 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:22:10 user nova-compute[72447]:       <target dev="tap8bf862f6-24"/>
Jul 31 12:22:10 user nova-compute[72447]:     </interface>
Jul 31 12:22:10 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:22:10 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/console.log" append="off"/>
Jul 31 12:22:10 user nova-compute[72447]:     </serial>
Jul 31 12:22:10 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:22:10 user nova-compute[72447]:     <video>
Jul 31 12:22:10 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:22:10 user nova-compute[72447]:     </video>
Jul 31 12:22:10 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:22:10 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:22:10 user nova-compute[72447]:     </rng>
Jul 31 12:22:10 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:22:10 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:22:10 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:22:10 user nova-compute[72447]:     </memballoon>
Jul 31 12:22:10 user nova-compute[72447]:   </devices>
Jul 31 12:22:10 user nova-compute[72447]: </domain>
Jul 31 12:22:10 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-89958571',display_name='tempest-ServerActionsTestOtherB-server-89958571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-89958571',id=17,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+f+k0iUUuOhXlHDtikwFngFfrKZWO/pXd3lnR3i6FVV78yfGidAD1wnO5wJJhLxF9aq2IfkjSAFEQM+7NMJo1w081YcYQwauvTLFPqn5c5JoXRC/7+8j1JXyzJ3lUTfg==',key_name='tempest-keypair-1372814901',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:20:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2cdf6c9123e14bf7aa1dc369852d1f06',ramdisk_id='',reservation_id='r-6pk3jb2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1175098759',owner_user_name='tempest-ServerActionsTestOtherB-1175098759-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:21:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='179d710ed6d3412bbfd665d30ccc6451',uuid=92ff498b-1337-47da-aaf1-b5fb9f19e98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converting VIF {"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG os_vif [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bf862f6-24, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8bf862f6-24, col_values=(('external_ids', {'iface-id': '8bf862f6-240f-47c4-bf1a-3cf399024ae2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:df:6b', 'vm-uuid': '92ff498b-1337-47da-aaf1-b5fb9f19e98d'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:22:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:10 user nova-compute[72447]: INFO os_vif [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24')
Jul 31 12:22:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-86fc80ae-f84c-4512-bba3-14dedc479f03 req-4e5bd6a3-eaa1-44d6-bfd0-65f9360dfbd0 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:22:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-86fc80ae-f84c-4512-bba3-14dedc479f03 req-4e5bd6a3-eaa1-44d6-bfd0-65f9360dfbd0 service nova] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-86fc80ae-f84c-4512-bba3-14dedc479f03 req-4e5bd6a3-eaa1-44d6-bfd0-65f9360dfbd0 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-86fc80ae-f84c-4512-bba3-14dedc479f03 req-4e5bd6a3-eaa1-44d6-bfd0-65f9360dfbd0 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-86fc80ae-f84c-4512-bba3-14dedc479f03 req-4e5bd6a3-eaa1-44d6-bfd0-65f9360dfbd0 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] No waiting events found dispatching network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:22:11 user nova-compute[72447]: WARNING nova.compute.manager [req-86fc80ae-f84c-4512-bba3-14dedc479f03 req-4e5bd6a3-eaa1-44d6-bfd0-65f9360dfbd0 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received unexpected event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 for instance with vm_state resized and task_state resize_reverting.
Jul 31 12:22:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:12 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806117.5662286, 92ff498b-1337-47da-aaf1-b5fb9f19e98d => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:22:12 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] VM Stopped (Lifecycle Event)
Jul 31 12:22:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-604ebce9-7f21-4a9b-9ffb-5b2314cabc06 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:22:13 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806133.859155, 92ff498b-1337-47da-aaf1-b5fb9f19e98d => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:22:13 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] VM Resumed (Lifecycle Event)
Jul 31 12:22:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:22:13 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Instance running successfully.
Jul 31 12:22:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] finish_revert_migration finished successfully. {{(pid=72447) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 31 12:22:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:22:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:22:13 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 31 12:22:13 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806133.8641055, 92ff498b-1337-47da-aaf1-b5fb9f19e98d => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:22:13 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] VM Started (Lifecycle Event)
Jul 31 12:22:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-87ae2dbe-99b3-4969-a01e-64f6895950e4 req-0ed1e404-e05d-4905-b17c-e9ac32580397 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:22:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-87ae2dbe-99b3-4969-a01e-64f6895950e4 req-0ed1e404-e05d-4905-b17c-e9ac32580397 service nova] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-87ae2dbe-99b3-4969-a01e-64f6895950e4 req-0ed1e404-e05d-4905-b17c-e9ac32580397 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-87ae2dbe-99b3-4969-a01e-64f6895950e4 req-0ed1e404-e05d-4905-b17c-e9ac32580397 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-87ae2dbe-99b3-4969-a01e-64f6895950e4 req-0ed1e404-e05d-4905-b17c-e9ac32580397 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] No waiting events found dispatching network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:22:13 user nova-compute[72447]: WARNING nova.compute.manager [req-87ae2dbe-99b3-4969-a01e-64f6895950e4 req-0ed1e404-e05d-4905-b17c-e9ac32580397 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received unexpected event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 for instance with vm_state resized and task_state resize_reverting.
Jul 31 12:22:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:22:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:22:13 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 31 12:22:14 user nova-compute[72447]: INFO nova.compute.manager [None req-e80ee0b0-154b-497f-b788-faecadce1aad tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating instance to original state: 'active'
Jul 31 12:22:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "87220d5b-df7b-4664-a5e8-088157130701" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:16 user nova-compute[72447]: INFO nova.compute.manager [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Unshelving
Jul 31 12:22:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:16 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'pci_requests' on Instance uuid 87220d5b-df7b-4664-a5e8-088157130701 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:22:16 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'numa_topology' on Instance uuid 87220d5b-df7b-4664-a5e8-088157130701 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:22:16 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:22:16 user nova-compute[72447]: INFO nova.compute.claims [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Claim successful on node user
Jul 31 12:22:17 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:22:17 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:22:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:17 user nova-compute[72447]: INFO nova.network.neutron [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Updating port fcf8adb7-881f-403d-bc7b-27a782db1dd5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquired lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG nova.compute.manager [req-c762d246-9664-4787-8ae0-8682945ed7ee req-dd5a6614-9c30-4692-9349-7ca735419a6c service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-changed-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG nova.compute.manager [req-c762d246-9664-4787-8ae0-8682945ed7ee req-dd5a6614-9c30-4692-9349-7ca735419a6c service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Refreshing instance network info cache due to event network-changed-fcf8adb7-881f-403d-bc7b-27a782db1dd5. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c762d246-9664-4787-8ae0-8682945ed7ee req-dd5a6614-9c30-4692-9349-7ca735419a6c service nova] Acquiring lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG nova.network.neutron [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Updating instance_info_cache with network_info: [{"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Releasing lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:22:18 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Creating image(s)
Jul 31 12:22:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "/opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "/opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "/opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'trusted_certs' on Instance uuid 87220d5b-df7b-4664-a5e8-088157130701 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c762d246-9664-4787-8ae0-8682945ed7ee req-dd5a6614-9c30-4692-9349-7ca735419a6c service nova] Acquired lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG nova.network.neutron [req-c762d246-9664-4787-8ae0-8682945ed7ee req-dd5a6614-9c30-4692-9349-7ca735419a6c service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Refreshing network info cache for port fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "784ac8e352a7fea941e6af41c7bdeca96045d00b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "784ac8e352a7fea941e6af41c7bdeca96045d00b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b.part --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b.part --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:19 user nova-compute[72447]: DEBUG nova.virt.images [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] 880f1411-5daf-4055-9496-7f58698c558e was qcow2, converting to raw {{(pid=72447) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 12:22:19 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:22:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b.part /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b.converted {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG nova.network.neutron [req-c762d246-9664-4787-8ae0-8682945ed7ee req-dd5a6614-9c30-4692-9349-7ca735419a6c service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Updated VIF entry in instance network info cache for port fcf8adb7-881f-403d-bc7b-27a782db1dd5. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG nova.network.neutron [req-c762d246-9664-4787-8ae0-8682945ed7ee req-dd5a6614-9c30-4692-9349-7ca735419a6c service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Updating instance_info_cache with network_info: [{"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c762d246-9664-4787-8ae0-8682945ed7ee req-dd5a6614-9c30-4692-9349-7ca735419a6c service nova] Releasing lock "refresh_cache-87220d5b-df7b-4664-a5e8-088157130701" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b.part /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b.converted" returned: 0 in 0.529s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b.converted --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b.converted --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "784ac8e352a7fea941e6af41c7bdeca96045d00b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.098s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "784ac8e352a7fea941e6af41c7bdeca96045d00b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "784ac8e352a7fea941e6af41c7bdeca96045d00b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b,backing_fmt=raw /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b,backing_fmt=raw /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk 1073741824" returned: 0 in 0.048s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "784ac8e352a7fea941e6af41c7bdeca96045d00b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:21 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'migration_context' on Instance uuid 87220d5b-df7b-4664-a5e8-088157130701 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:22:21 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Rebasing disk image.
Jul 31 12:22:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c -F raw /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c -F raw /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk" returned: 0 in 2.549s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Ensure instance console log exists: /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Start _get_guest_xml network_info=[{"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='163634fb6a5daf35b6f8a403fa8e7496',container_format='bare',created_at=2023-07-31T12:20:24Z,direct_url=<?>,disk_format='qcow2',id=880f1411-5daf-4055-9496-7f58698c558e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1809185140-shelved',owner='8b8dd0d543cb4786afc39e88f440e538',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-31T12:20:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:22:23 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:22:23 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='163634fb6a5daf35b6f8a403fa8e7496',container_format='bare',created_at=2023-07-31T12:20:24Z,direct_url=<?>,disk_format='qcow2',id=880f1411-5daf-4055-9496-7f58698c558e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1809185140-shelved',owner='8b8dd0d543cb4786afc39e88f440e538',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-31T12:20:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'vcpu_model' on Instance uuid 87220d5b-df7b-4664-a5e8-088157130701 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1809185140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1809185140',id=21,image_ref='880f1411-5daf-4055-9496-7f58698c558e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1672108798',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:18:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8b8dd0d543cb4786afc39e88f440e538',ramdisk_id='',reservation_id='r-fx3n0x08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1971436108',owner_user_name='tempest-AttachVolumeShelveTestJSON-1971436108-project-member',shelved_at='2023-07-31T12:20:28.271236',shelved_host='user',shelved_image_id='880f1411-5daf-4055-9496-7f58698c558e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:22:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc465160a3a94498ab1aa3aa44280b12',uuid=87220d5b-df7b-4664-a5e8-088157130701,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converting VIF {"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.objects.instance [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'pci_devices' on Instance uuid 87220d5b-df7b-4664-a5e8-088157130701 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:22:23 user nova-compute[72447]:   <uuid>87220d5b-df7b-4664-a5e8-088157130701</uuid>
Jul 31 12:22:23 user nova-compute[72447]:   <name>instance-00000015</name>
Jul 31 12:22:23 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:22:23 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:22:23 user nova-compute[72447]:   <metadata>
Jul 31 12:22:23 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:22:23 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:22:23 user nova-compute[72447]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1809185140</nova:name>
Jul 31 12:22:23 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:22:23</nova:creationTime>
Jul 31 12:22:23 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:22:23 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:22:23 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:22:23 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:22:23 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:22:23 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:22:23 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:22:23 user nova-compute[72447]:       <nova:owner>
Jul 31 12:22:23 user nova-compute[72447]:         <nova:user uuid="cc465160a3a94498ab1aa3aa44280b12">tempest-AttachVolumeShelveTestJSON-1971436108-project-member</nova:user>
Jul 31 12:22:23 user nova-compute[72447]:         <nova:project uuid="8b8dd0d543cb4786afc39e88f440e538">tempest-AttachVolumeShelveTestJSON-1971436108</nova:project>
Jul 31 12:22:23 user nova-compute[72447]:       </nova:owner>
Jul 31 12:22:23 user nova-compute[72447]:       <nova:root type="image" uuid="880f1411-5daf-4055-9496-7f58698c558e"/>
Jul 31 12:22:23 user nova-compute[72447]:       <nova:ports>
Jul 31 12:22:23 user nova-compute[72447]:         <nova:port uuid="fcf8adb7-881f-403d-bc7b-27a782db1dd5">
Jul 31 12:22:23 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 12:22:23 user nova-compute[72447]:         </nova:port>
Jul 31 12:22:23 user nova-compute[72447]:       </nova:ports>
Jul 31 12:22:23 user nova-compute[72447]:     </nova:instance>
Jul 31 12:22:23 user nova-compute[72447]:   </metadata>
Jul 31 12:22:23 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:22:23 user nova-compute[72447]:     <system>
Jul 31 12:22:23 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:22:23 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:22:23 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:22:23 user nova-compute[72447]:       <entry name="serial">87220d5b-df7b-4664-a5e8-088157130701</entry>
Jul 31 12:22:23 user nova-compute[72447]:       <entry name="uuid">87220d5b-df7b-4664-a5e8-088157130701</entry>
Jul 31 12:22:23 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:22:23 user nova-compute[72447]:     </system>
Jul 31 12:22:23 user nova-compute[72447]:   </sysinfo>
Jul 31 12:22:23 user nova-compute[72447]:   <os>
Jul 31 12:22:23 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:22:23 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:22:23 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:22:23 user nova-compute[72447]:   </os>
Jul 31 12:22:23 user nova-compute[72447]:   <features>
Jul 31 12:22:23 user nova-compute[72447]:     <acpi/>
Jul 31 12:22:23 user nova-compute[72447]:     <apic/>
Jul 31 12:22:23 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:22:23 user nova-compute[72447]:   </features>
Jul 31 12:22:23 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:22:23 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:22:23 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:22:23 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:22:23 user nova-compute[72447]:   </clock>
Jul 31 12:22:23 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:22:23 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:22:23 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:22:23 user nova-compute[72447]:   </cpu>
Jul 31 12:22:23 user nova-compute[72447]:   <devices>
Jul 31 12:22:23 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:22:23 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:22:23 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk"/>
Jul 31 12:22:23 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:22:23 user nova-compute[72447]:     </disk>
Jul 31 12:22:23 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:22:23 user nova-compute[72447]:       <mac address="fa:16:3e:34:5b:8d"/>
Jul 31 12:22:23 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:22:23 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:22:23 user nova-compute[72447]:       <target dev="tapfcf8adb7-88"/>
Jul 31 12:22:23 user nova-compute[72447]:     </interface>
Jul 31 12:22:23 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:22:23 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/console.log" append="off"/>
Jul 31 12:22:23 user nova-compute[72447]:     </serial>
Jul 31 12:22:23 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:22:23 user nova-compute[72447]:     <video>
Jul 31 12:22:23 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:22:23 user nova-compute[72447]:     </video>
Jul 31 12:22:23 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:22:23 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:22:23 user nova-compute[72447]:     </rng>
Jul 31 12:22:23 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:22:23 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:22:23 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:22:23 user nova-compute[72447]:     </memballoon>
Jul 31 12:22:23 user nova-compute[72447]:   </devices>
Jul 31 12:22:23 user nova-compute[72447]: </domain>
Jul 31 12:22:23 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1809185140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1809185140',id=21,image_ref='880f1411-5daf-4055-9496-7f58698c558e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1672108798',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:18:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8b8dd0d543cb4786afc39e88f440e538',ramdisk_id='',reservation_id='r-fx3n0x08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1971436108',owner_user_name='tempest-AttachVolumeShelveTestJSON-1971436108-project-member',shelved_at='2023-07-31T12:20:28.271236',shelved_host='user',shelved_image_id='880f1411-5daf-4055-9496-7f58698c558e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:22:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc465160a3a94498ab1aa3aa44280b12',uuid=87220d5b-df7b-4664-a5e8-088157130701,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converting VIF {"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG os_vif [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcf8adb7-88, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcf8adb7-88, col_values=(('external_ids', {'iface-id': 'fcf8adb7-881f-403d-bc7b-27a782db1dd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:5b:8d', 'vm-uuid': '87220d5b-df7b-4664-a5e8-088157130701'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:22:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:24 user nova-compute[72447]: INFO os_vif [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88')
Jul 31 12:22:24 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:22:24 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] No VIF found with MAC fa:16:3e:34:5b:8d, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:22:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-d1fd766e-d892-4855-a7d4-0e320c8377f3 req-6914223f-2f00-43e0-922a-f6c4b3c27b3e service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:22:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d1fd766e-d892-4855-a7d4-0e320c8377f3 req-6914223f-2f00-43e0-922a-f6c4b3c27b3e service nova] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d1fd766e-d892-4855-a7d4-0e320c8377f3 req-6914223f-2f00-43e0-922a-f6c4b3c27b3e service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d1fd766e-d892-4855-a7d4-0e320c8377f3 req-6914223f-2f00-43e0-922a-f6c4b3c27b3e service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-d1fd766e-d892-4855-a7d4-0e320c8377f3 req-6914223f-2f00-43e0-922a-f6c4b3c27b3e service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] No waiting events found dispatching network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:22:25 user nova-compute[72447]: WARNING nova.compute.manager [req-d1fd766e-d892-4855-a7d4-0e320c8377f3 req-6914223f-2f00-43e0-922a-f6c4b3c27b3e service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received unexpected event network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 12:22:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:22:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:22:27 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806147.7189507, 87220d5b-df7b-4664-a5e8-088157130701 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:22:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] VM Resumed (Lifecycle Event)
Jul 31 12:22:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Instance spawned successfully.
Jul 31 12:22:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:22:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:22:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:22:27 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806147.7202725, 87220d5b-df7b-4664-a5e8-088157130701 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:22:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] VM Started (Lifecycle Event)
Jul 31 12:22:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-4713bed4-b6e5-40a1-b117-2c1f50cd701a req-368808a5-c701-4ded-b545-37d5881e9a88 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:22:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4713bed4-b6e5-40a1-b117-2c1f50cd701a req-368808a5-c701-4ded-b545-37d5881e9a88 service nova] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4713bed4-b6e5-40a1-b117-2c1f50cd701a req-368808a5-c701-4ded-b545-37d5881e9a88 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4713bed4-b6e5-40a1-b117-2c1f50cd701a req-368808a5-c701-4ded-b545-37d5881e9a88 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-4713bed4-b6e5-40a1-b117-2c1f50cd701a req-368808a5-c701-4ded-b545-37d5881e9a88 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] No waiting events found dispatching network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:22:27 user nova-compute[72447]: WARNING nova.compute.manager [req-4713bed4-b6e5-40a1-b117-2c1f50cd701a req-368808a5-c701-4ded-b545-37d5881e9a88 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received unexpected event network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 12:22:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:22:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:22:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:22:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:22:28 user nova-compute[72447]: INFO nova.compute.manager [None req-fa8f5c49-73ca-425e-ba11-63996dd07a1a tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Unrescuing
Jul 31 12:22:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fa8f5c49-73ca-425e-ba11-63996dd07a1a tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fa8f5c49-73ca-425e-ba11-63996dd07a1a tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquired lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG nova.network.neutron [None req-fa8f5c49-73ca-425e-ba11-63996dd07a1a tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-0966dc92-7ace-49b7-b5ce-5df58ff22e14 tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "87220d5b-df7b-4664-a5e8-088157130701" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.398s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:22:28 user nova-compute[72447]: INFO nova.compute.claims [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Claim successful on node user
Jul 31 12:22:28 user nova-compute[72447]: DEBUG nova.network.neutron [None req-fa8f5c49-73ca-425e-ba11-63996dd07a1a tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Updating instance_info_cache with network_info: [{"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fa8f5c49-73ca-425e-ba11-63996dd07a1a tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Releasing lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fa8f5c49-73ca-425e-ba11-63996dd07a1a tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'flavor' on Instance uuid 0dbd2353-0521-4e92-8722-6151bfb40924 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:22:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.784s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG nova.network.neutron [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:22:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-6878bbc3-9156-4667-b293-b0cca653f750 req-f1071ef6-6605-4d72-82e6-359cbe016f26 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-unplugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6878bbc3-9156-4667-b293-b0cca653f750 req-f1071ef6-6605-4d72-82e6-359cbe016f26 service nova] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6878bbc3-9156-4667-b293-b0cca653f750 req-f1071ef6-6605-4d72-82e6-359cbe016f26 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6878bbc3-9156-4667-b293-b0cca653f750 req-f1071ef6-6605-4d72-82e6-359cbe016f26 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-6878bbc3-9156-4667-b293-b0cca653f750 req-f1071ef6-6605-4d72-82e6-359cbe016f26 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] No waiting events found dispatching network-vif-unplugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:22:29 user nova-compute[72447]: WARNING nova.compute.manager [req-6878bbc3-9156-4667-b293-b0cca653f750 req-f1071ef6-6605-4d72-82e6-359cbe016f26 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received unexpected event network-vif-unplugged-7e1213ee-4076-42af-a8cb-d3825739d314 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:22:29 user nova-compute[72447]: DEBUG nova.policy [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a40e5176e01443a085c01fc677cc8ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c212a5254bcc4de290ec4bfbf8fbbd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:22:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Creating image(s)
Jul 31 12:22:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "/opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "/opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "/opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "73afd3a2c0a95240195a9439e42829f73da89d20" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "73afd3a2c0a95240195a9439e42829f73da89d20" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20.part --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Instance destroyed successfully.
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20.part --force-share --output=json" returned: 0 in 0.322s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG nova.virt.images [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] 068ab2c0-eb0f-418e-bf5c-b80f8416ab91 was qcow2, converting to raw {{(pid=72447) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20.part /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20.converted {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20.part /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20.converted" returned: 0 in 0.197s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20.converted --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20.converted --force-share --output=json" returned: 0 in 0.162s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "73afd3a2c0a95240195a9439e42829f73da89d20" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.213s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20 --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG nova.network.neutron [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Successfully created port: 69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20 --force-share --output=json" returned: 0 in 0.179s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "73afd3a2c0a95240195a9439e42829f73da89d20" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "73afd3a2c0a95240195a9439e42829f73da89d20" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20 --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20 --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20,backing_fmt=raw /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20,backing_fmt=raw /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk 1073741824" returned: 0 in 0.057s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "73afd3a2c0a95240195a9439e42829f73da89d20" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20 --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20 --force-share --output=json" returned: 0 in 0.150s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Cannot resize image /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.objects.instance [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'migration_context' on Instance uuid 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Ensure instance console log exists: /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-f4a63045-0bb2-40c7-ba28-c9096932762c req-36211b15-4a5d-4e7b-b91d-710f50b2d6e4 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f4a63045-0bb2-40c7-ba28-c9096932762c req-36211b15-4a5d-4e7b-b91d-710f50b2d6e4 service nova] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f4a63045-0bb2-40c7-ba28-c9096932762c req-36211b15-4a5d-4e7b-b91d-710f50b2d6e4 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f4a63045-0bb2-40c7-ba28-c9096932762c req-36211b15-4a5d-4e7b-b91d-710f50b2d6e4 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-f4a63045-0bb2-40c7-ba28-c9096932762c req-36211b15-4a5d-4e7b-b91d-710f50b2d6e4 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] No waiting events found dispatching network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:22:31 user nova-compute[72447]: WARNING nova.compute.manager [req-f4a63045-0bb2-40c7-ba28-c9096932762c req-36211b15-4a5d-4e7b-b91d-710f50b2d6e4 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received unexpected event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:22:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Successfully updated port: 69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquired lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-d8c02a02-4c15-4e1f-9bdf-9097ad76637a req-132eb5ac-c288-4835-88dd-78b0471bd33e service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-changed-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-d8c02a02-4c15-4e1f-9bdf-9097ad76637a req-132eb5ac-c288-4835-88dd-78b0471bd33e service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Refreshing instance network info cache due to event network-changed-69b9e7de-13a8-4339-b2df-8547ea668cd7. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d8c02a02-4c15-4e1f-9bdf-9097ad76637a req-132eb5ac-c288-4835-88dd-78b0471bd33e service nova] Acquiring lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updating instance_info_cache with network_info: [{"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Releasing lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Instance network_info: |[{"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d8c02a02-4c15-4e1f-9bdf-9097ad76637a req-132eb5ac-c288-4835-88dd-78b0471bd33e service nova] Acquired lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-d8c02a02-4c15-4e1f-9bdf-9097ad76637a req-132eb5ac-c288-4835-88dd-78b0471bd33e service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Refreshing network info cache for port 69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Start _get_guest_xml network_info=[{"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:22:25Z,direct_url=<?>,disk_format='qcow2',id=068ab2c0-eb0f-418e-bf5c-b80f8416ab91,min_disk=0,min_ram=0,name='tempest-scenario-img--236710821',owner='c212a5254bcc4de290ec4bfbf8fbbd4b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:22:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '068ab2c0-eb0f-418e-bf5c-b80f8416ab91'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:22:31 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:22:31 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:22:25Z,direct_url=<?>,disk_format='qcow2',id=068ab2c0-eb0f-418e-bf5c-b80f8416ab91,min_disk=0,min_ram=0,name='tempest-scenario-img--236710821',owner='c212a5254bcc4de290ec4bfbf8fbbd4b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:22:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-528983916',display_name='tempest-TestMinimumBasicScenario-server-528983916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-528983916',id=29,image_ref='068ab2c0-eb0f-418e-bf5c-b80f8416ab91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXWQd7b8R3FDL7h32YpLaEJV+a2YjMmFR2pbrbElCn70KgjvuyTBwxzK4ClGRdvqvKFvF9MQu1fTjG43uJtP4Fb3pDugeDq6/vZiyQ4gSRZV86R+0/OsjSKoxj4OfzRoA==',key_name='tempest-TestMinimumBasicScenario-624029761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c212a5254bcc4de290ec4bfbf8fbbd4b',ramdisk_id='',reservation_id='r-1olioo2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='068ab2c0-eb0f-418e-bf5c-b80f8416ab91',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1422809681',owner_user_name='tempest-TestMinimumBasicScenario-1422809681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:22:29Z,user_data=None,user_id='a40e5176e01443a085c01fc677cc8ca9',uuid=12c7098d-b640-43ae-9e9c-a2cd6edf3eaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converting VIF {"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:18:63,bridge_name='br-int',has_traffic_filtering=True,id=69b9e7de-13a8-4339-b2df-8547ea668cd7,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9e7de-13') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.objects.instance [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'pci_devices' on Instance uuid 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:22:31 user nova-compute[72447]:   <uuid>12c7098d-b640-43ae-9e9c-a2cd6edf3eaa</uuid>
Jul 31 12:22:31 user nova-compute[72447]:   <name>instance-0000001d</name>
Jul 31 12:22:31 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:22:31 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:22:31 user nova-compute[72447]:   <metadata>
Jul 31 12:22:31 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:22:31 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:22:31 user nova-compute[72447]:       <nova:name>tempest-TestMinimumBasicScenario-server-528983916</nova:name>
Jul 31 12:22:31 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:22:31</nova:creationTime>
Jul 31 12:22:31 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:22:31 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:22:31 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:22:31 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:22:31 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:22:31 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:22:31 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:22:31 user nova-compute[72447]:       <nova:owner>
Jul 31 12:22:31 user nova-compute[72447]:         <nova:user uuid="a40e5176e01443a085c01fc677cc8ca9">tempest-TestMinimumBasicScenario-1422809681-project-member</nova:user>
Jul 31 12:22:31 user nova-compute[72447]:         <nova:project uuid="c212a5254bcc4de290ec4bfbf8fbbd4b">tempest-TestMinimumBasicScenario-1422809681</nova:project>
Jul 31 12:22:31 user nova-compute[72447]:       </nova:owner>
Jul 31 12:22:31 user nova-compute[72447]:       <nova:root type="image" uuid="068ab2c0-eb0f-418e-bf5c-b80f8416ab91"/>
Jul 31 12:22:31 user nova-compute[72447]:       <nova:ports>
Jul 31 12:22:31 user nova-compute[72447]:         <nova:port uuid="69b9e7de-13a8-4339-b2df-8547ea668cd7">
Jul 31 12:22:31 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:22:31 user nova-compute[72447]:         </nova:port>
Jul 31 12:22:31 user nova-compute[72447]:       </nova:ports>
Jul 31 12:22:31 user nova-compute[72447]:     </nova:instance>
Jul 31 12:22:31 user nova-compute[72447]:   </metadata>
Jul 31 12:22:31 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:22:31 user nova-compute[72447]:     <system>
Jul 31 12:22:31 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:22:31 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:22:31 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:22:31 user nova-compute[72447]:       <entry name="serial">12c7098d-b640-43ae-9e9c-a2cd6edf3eaa</entry>
Jul 31 12:22:31 user nova-compute[72447]:       <entry name="uuid">12c7098d-b640-43ae-9e9c-a2cd6edf3eaa</entry>
Jul 31 12:22:31 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:22:31 user nova-compute[72447]:     </system>
Jul 31 12:22:31 user nova-compute[72447]:   </sysinfo>
Jul 31 12:22:31 user nova-compute[72447]:   <os>
Jul 31 12:22:31 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:22:31 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:22:31 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:22:31 user nova-compute[72447]:   </os>
Jul 31 12:22:31 user nova-compute[72447]:   <features>
Jul 31 12:22:31 user nova-compute[72447]:     <acpi/>
Jul 31 12:22:31 user nova-compute[72447]:     <apic/>
Jul 31 12:22:31 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:22:31 user nova-compute[72447]:   </features>
Jul 31 12:22:31 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:22:31 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:22:31 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:22:31 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:22:31 user nova-compute[72447]:   </clock>
Jul 31 12:22:31 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:22:31 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:22:31 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:22:31 user nova-compute[72447]:   </cpu>
Jul 31 12:22:31 user nova-compute[72447]:   <devices>
Jul 31 12:22:31 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:22:31 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:22:31 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk"/>
Jul 31 12:22:31 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:22:31 user nova-compute[72447]:     </disk>
Jul 31 12:22:31 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:22:31 user nova-compute[72447]:       <mac address="fa:16:3e:76:18:63"/>
Jul 31 12:22:31 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:22:31 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:22:31 user nova-compute[72447]:       <target dev="tap69b9e7de-13"/>
Jul 31 12:22:31 user nova-compute[72447]:     </interface>
Jul 31 12:22:31 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:22:31 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/console.log" append="off"/>
Jul 31 12:22:31 user nova-compute[72447]:     </serial>
Jul 31 12:22:31 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:22:31 user nova-compute[72447]:     <video>
Jul 31 12:22:31 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:22:31 user nova-compute[72447]:     </video>
Jul 31 12:22:31 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:22:31 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:22:31 user nova-compute[72447]:     </rng>
Jul 31 12:22:31 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:22:31 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:22:31 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:22:31 user nova-compute[72447]:     </memballoon>
Jul 31 12:22:31 user nova-compute[72447]:   </devices>
Jul 31 12:22:31 user nova-compute[72447]: </domain>
Jul 31 12:22:31 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-528983916',display_name='tempest-TestMinimumBasicScenario-server-528983916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-528983916',id=29,image_ref='068ab2c0-eb0f-418e-bf5c-b80f8416ab91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXWQd7b8R3FDL7h32YpLaEJV+a2YjMmFR2pbrbElCn70KgjvuyTBwxzK4ClGRdvqvKFvF9MQu1fTjG43uJtP4Fb3pDugeDq6/vZiyQ4gSRZV86R+0/OsjSKoxj4OfzRoA==',key_name='tempest-TestMinimumBasicScenario-624029761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c212a5254bcc4de290ec4bfbf8fbbd4b',ramdisk_id='',reservation_id='r-1olioo2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='068ab2c0-eb0f-418e-bf5c-b80f8416ab91',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1422809681',owner_user_name='tempest-TestMinimumBasicScenario-1422809681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:22:29Z,user_data=None,user_id='a40e5176e01443a085c01fc677cc8ca9',uuid=12c7098d-b640-43ae-9e9c-a2cd6edf3eaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converting VIF {"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:18:63,bridge_name='br-int',has_traffic_filtering=True,id=69b9e7de-13a8-4339-b2df-8547ea668cd7,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9e7de-13') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG os_vif [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:18:63,bridge_name='br-int',has_traffic_filtering=True,id=69b9e7de-13a8-4339-b2df-8547ea668cd7,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9e7de-13') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69b9e7de-13, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:22:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69b9e7de-13, col_values=(('external_ids', {'iface-id': '69b9e7de-13a8-4339-b2df-8547ea668cd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:18:63', 'vm-uuid': '12c7098d-b640-43ae-9e9c-a2cd6edf3eaa'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:22:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:22:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:32 user nova-compute[72447]: INFO os_vif [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:18:63,bridge_name='br-int',has_traffic_filtering=True,id=69b9e7de-13a8-4339-b2df-8547ea668cd7,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9e7de-13')
Jul 31 12:22:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:22:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] No VIF found with MAC fa:16:3e:76:18:63, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:22:32 user nova-compute[72447]: DEBUG nova.network.neutron [req-d8c02a02-4c15-4e1f-9bdf-9097ad76637a req-132eb5ac-c288-4835-88dd-78b0471bd33e service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updated VIF entry in instance network info cache for port 69b9e7de-13a8-4339-b2df-8547ea668cd7. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:22:32 user nova-compute[72447]: DEBUG nova.network.neutron [req-d8c02a02-4c15-4e1f-9bdf-9097ad76637a req-132eb5ac-c288-4835-88dd-78b0471bd33e service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updating instance_info_cache with network_info: [{"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:22:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d8c02a02-4c15-4e1f-9bdf-9097ad76637a req-132eb5ac-c288-4835-88dd-78b0471bd33e service nova] Releasing lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:22:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-80b82d3b-6140-4c7c-a09f-47d55e72dbcd req-16910329-d371-4403-a193-8f2d693366a0 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b82d3b-6140-4c7c-a09f-47d55e72dbcd req-16910329-d371-4403-a193-8f2d693366a0 service nova] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b82d3b-6140-4c7c-a09f-47d55e72dbcd req-16910329-d371-4403-a193-8f2d693366a0 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b82d3b-6140-4c7c-a09f-47d55e72dbcd req-16910329-d371-4403-a193-8f2d693366a0 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-80b82d3b-6140-4c7c-a09f-47d55e72dbcd req-16910329-d371-4403-a193-8f2d693366a0 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] No waiting events found dispatching network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:22:33 user nova-compute[72447]: WARNING nova.compute.manager [req-80b82d3b-6140-4c7c-a09f-47d55e72dbcd req-16910329-d371-4403-a193-8f2d693366a0 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received unexpected event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:22:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-80b82d3b-6140-4c7c-a09f-47d55e72dbcd req-16910329-d371-4403-a193-8f2d693366a0 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b82d3b-6140-4c7c-a09f-47d55e72dbcd req-16910329-d371-4403-a193-8f2d693366a0 service nova] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b82d3b-6140-4c7c-a09f-47d55e72dbcd req-16910329-d371-4403-a193-8f2d693366a0 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80b82d3b-6140-4c7c-a09f-47d55e72dbcd req-16910329-d371-4403-a193-8f2d693366a0 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-80b82d3b-6140-4c7c-a09f-47d55e72dbcd req-16910329-d371-4403-a193-8f2d693366a0 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] No waiting events found dispatching network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:22:33 user nova-compute[72447]: WARNING nova.compute.manager [req-80b82d3b-6140-4c7c-a09f-47d55e72dbcd req-16910329-d371-4403-a193-8f2d693366a0 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received unexpected event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:22:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 0dbd2353-0521-4e92-8722-6151bfb40924 due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806153.8750381, 0dbd2353-0521-4e92-8722-6151bfb40924 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:22:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] VM Resumed (Lifecycle Event)
Jul 31 12:22:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fa8f5c49-73ca-425e-ba11-63996dd07a1a tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:22:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 12:22:33 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806153.877749, 0dbd2353-0521-4e92-8722-6151bfb40924 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:22:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] VM Started (Lifecycle Event)
Jul 31 12:22:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:22:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:22:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-a65acbbe-4aeb-454d-8a68-b5eacd70f2c9 req-b4015296-90f9-4321-88cc-d37e30e1cfcb service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a65acbbe-4aeb-454d-8a68-b5eacd70f2c9 req-b4015296-90f9-4321-88cc-d37e30e1cfcb service nova] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a65acbbe-4aeb-454d-8a68-b5eacd70f2c9 req-b4015296-90f9-4321-88cc-d37e30e1cfcb service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a65acbbe-4aeb-454d-8a68-b5eacd70f2c9 req-b4015296-90f9-4321-88cc-d37e30e1cfcb service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-a65acbbe-4aeb-454d-8a68-b5eacd70f2c9 req-b4015296-90f9-4321-88cc-d37e30e1cfcb service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] No waiting events found dispatching network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:22:35 user nova-compute[72447]: WARNING nova.compute.manager [req-a65acbbe-4aeb-454d-8a68-b5eacd70f2c9 req-b4015296-90f9-4321-88cc-d37e30e1cfcb service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received unexpected event network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 for instance with vm_state building and task_state spawning.
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-a65acbbe-4aeb-454d-8a68-b5eacd70f2c9 req-b4015296-90f9-4321-88cc-d37e30e1cfcb service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a65acbbe-4aeb-454d-8a68-b5eacd70f2c9 req-b4015296-90f9-4321-88cc-d37e30e1cfcb service nova] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a65acbbe-4aeb-454d-8a68-b5eacd70f2c9 req-b4015296-90f9-4321-88cc-d37e30e1cfcb service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a65acbbe-4aeb-454d-8a68-b5eacd70f2c9 req-b4015296-90f9-4321-88cc-d37e30e1cfcb service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-a65acbbe-4aeb-454d-8a68-b5eacd70f2c9 req-b4015296-90f9-4321-88cc-d37e30e1cfcb service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] No waiting events found dispatching network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:22:35 user nova-compute[72447]: WARNING nova.compute.manager [req-a65acbbe-4aeb-454d-8a68-b5eacd70f2c9 req-b4015296-90f9-4321-88cc-d37e30e1cfcb service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received unexpected event network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 for instance with vm_state building and task_state spawning.
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806155.7399924, 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:22:35 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] VM Resumed (Lifecycle Event)
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:22:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Instance spawned successfully.
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:22:35 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806155.7439115, 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:22:35 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] VM Started (Lifecycle Event)
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:22:35 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:22:35 user nova-compute[72447]: INFO nova.compute.manager [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Took 6.62 seconds to spawn the instance on the hypervisor.
Jul 31 12:22:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:22:35 user nova-compute[72447]: INFO nova.compute.manager [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Took 7.77 seconds to build instance.
Jul 31 12:22:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d59c316b-7d5a-498e-a861-9fd3b3efbe4d tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.878s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:51 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:22:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:22:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:22:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:22:53 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:22:54 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:22:54 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:22:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:56 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:22:56 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:22:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:56 user nova-compute[72447]: INFO nova.compute.manager [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Detaching volume bfb2e0a0-6d39-4cee-babb-47946fde6943
Jul 31 12:22:56 user nova-compute[72447]: INFO nova.virt.block_device [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Attempting to driver detach volume bfb2e0a0-6d39-4cee-babb-47946fde6943 from mountpoint /dev/vdb
Jul 31 12:22:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Attempting to detach device vdb from instance 51310b38-96e0-4d44-ab1e-8d2cc039617e from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:22:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:22:56 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:22:56 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:22:56 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:22:56 user nova-compute[72447]:   <serial>bfb2e0a0-6d39-4cee-babb-47946fde6943</serial>
Jul 31 12:22:56 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 12:22:56 user nova-compute[72447]: </disk>
Jul 31 12:22:56 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:22:56 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Successfully detached device vdb from instance 51310b38-96e0-4d44-ab1e-8d2cc039617e from the persistent domain config.
Jul 31 12:22:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51310b38-96e0-4d44-ab1e-8d2cc039617e from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:22:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:22:56 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:22:56 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:22:56 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:22:56 user nova-compute[72447]:   <serial>bfb2e0a0-6d39-4cee-babb-47946fde6943</serial>
Jul 31 12:22:56 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 12:22:56 user nova-compute[72447]: </disk>
Jul 31 12:22:56 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806177.1925905, 51310b38-96e0-4d44-ab1e-8d2cc039617e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:22:57 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Successfully detached device vdb from instance 51310b38-96e0-4d44-ab1e-8d2cc039617e from the live domain config.
Jul 31 12:22:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsHgfpdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:22:57 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[22452fbb-dccd-487c-af08-4cc6d353e7c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3b4727-d837-4f98-8874-54e187004789]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:22:57 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:22:57 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:22:57 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:22:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:22:57 user nova-compute[72447]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 (non-flash)
Jul 31 12:22:57 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:22:57 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:22:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f067c3ce9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943'): ({'sde'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Removing single pathed devices sde {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab19c0c-5328-4b1a-8759-7aacea57cf48]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c741180-cd6d-4287-baae-894683619f65]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Flushing IO for device /dev/sde {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeac773b-e091-41e8-8bbc-8651b607d80e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[42818815-9be0-4259-9e67-2a80d6ec693e]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcf997f-dbef-472c-9e21-dae1efd1638b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf446073-fd63-4ac4-a307-d9349a6e8a95]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260]
Jul 31 12:22:57 user nova-compute[72447]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943, portal: 172.16.0.220,3260] successful.
Jul 31 12:22:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb2e0a0-6d39-4cee-babb-47946fde6943 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1137b48-b712-4afe-8529-4a0d37a51758]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== disconnect_volume: return (329ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:22:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG nova.objects.instance [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'flavor' on Instance uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-43e94d8e-61a4-487d-8a6c-b35ce1c6a867 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.981s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:22:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:03 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:23:03 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=6724MB free_disk=24.991146087646484GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b291ba57-9fdb-48f2-ac0c-45a108dda3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b5fe9835-8278-449e-9069-18421cb088dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 483f6f7a-c61d-46dd-893b-29b80da3f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 92ff498b-1337-47da-aaf1-b5fb9f19e98d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6958347e-bd3b-4f4a-ae78-c282d7849a57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance fbcc2c79-e1c7-45bc-9d16-db05b1027732 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 8b487325-3b50-4f3f-857c-62fd0a64a6c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 87220d5b-df7b-4664-a5e8-088157130701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:23:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:23:04 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:23:04 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:23:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:23:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "6958347e-bd3b-4f4a-ae78-c282d7849a57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:04 user nova-compute[72447]: INFO nova.compute.manager [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Terminating instance
Jul 31 12:23:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-5e68e934-176e-4d88-9145-c6c82ff33c20 req-09ca2373-a4f2-4a42-b120-ccb1fb06ee8d service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Received event network-vif-unplugged-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5e68e934-176e-4d88-9145-c6c82ff33c20 req-09ca2373-a4f2-4a42-b120-ccb1fb06ee8d service nova] Acquiring lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5e68e934-176e-4d88-9145-c6c82ff33c20 req-09ca2373-a4f2-4a42-b120-ccb1fb06ee8d service nova] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5e68e934-176e-4d88-9145-c6c82ff33c20 req-09ca2373-a4f2-4a42-b120-ccb1fb06ee8d service nova] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-5e68e934-176e-4d88-9145-c6c82ff33c20 req-09ca2373-a4f2-4a42-b120-ccb1fb06ee8d service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] No waiting events found dispatching network-vif-unplugged-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-5e68e934-176e-4d88-9145-c6c82ff33c20 req-09ca2373-a4f2-4a42-b120-ccb1fb06ee8d service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Received event network-vif-unplugged-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:05 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Instance destroyed successfully.
Jul 31 12:23:05 user nova-compute[72447]: DEBUG nova.objects.instance [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lazy-loading 'resources' on Instance uuid 6958347e-bd3b-4f4a-ae78-c282d7849a57 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-441145672',display_name='tempest-ServersNegativeTestJSON-server-441145672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-441145672',id=26,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94646a9f184c43d4abbd4fac64c84344',ramdisk_id='',reservation_id='r-e9linpdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1687226877',owner_user_name='tempest-ServersNegativeTestJSON-1687226877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:21:22Z,user_data=None,user_id='f2c57df148eb4814a0b12ca7a6d9eda6',uuid=6958347e-bd3b-4f4a-ae78-c282d7849a57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "address": "fa:16:3e:db:2a:ed", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e7b3ce-27", "ovs_interfaceid": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Converting VIF {"id": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "address": "fa:16:3e:db:2a:ed", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e7b3ce-27", "ovs_interfaceid": "e6e7b3ce-27ab-426c-ad51-5e09fe4741a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6e7b3ce-27ab-426c-ad51-5e09fe4741a0,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e7b3ce-27') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG os_vif [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6e7b3ce-27ab-426c-ad51-5e09fe4741a0,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e7b3ce-27') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6e7b3ce-27, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:23:05 user nova-compute[72447]: INFO os_vif [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6e7b3ce-27ab-426c-ad51-5e09fe4741a0,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e7b3ce-27')
Jul 31 12:23:05 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Deleting instance files /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57_del
Jul 31 12:23:05 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Deletion of /opt/stack/data/nova/instances/6958347e-bd3b-4f4a-ae78-c282d7849a57_del complete
Jul 31 12:23:05 user nova-compute[72447]: INFO nova.compute.manager [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 31 12:23:05 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:23:05 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:23:06 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:23:06 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:23:06 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:23:06 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Took 0.51 seconds to deallocate network for instance.
Jul 31 12:23:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-bb4d7e8e-5dec-4653-80a9-9b6cb3321619 req-27ee3edc-c65e-4594-9583-533f82b3572b service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Received event network-vif-deleted-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:06 user nova-compute[72447]: INFO nova.compute.manager [req-bb4d7e8e-5dec-4653-80a9-9b6cb3321619 req-27ee3edc-c65e-4594-9583-533f82b3572b service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Neutron deleted interface e6e7b3ce-27ab-426c-ad51-5e09fe4741a0; detaching it from the instance and deleting it from the info cache
Jul 31 12:23:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-bb4d7e8e-5dec-4653-80a9-9b6cb3321619 req-27ee3edc-c65e-4594-9583-533f82b3572b service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:23:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-bb4d7e8e-5dec-4653-80a9-9b6cb3321619 req-27ee3edc-c65e-4594-9583-533f82b3572b service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Detach interface failed, port_id=e6e7b3ce-27ab-426c-ad51-5e09fe4741a0, reason: Instance 6958347e-bd3b-4f4a-ae78-c282d7849a57 could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:23:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:06 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:23:06 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:23:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:06 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Deleted allocations for instance 6958347e-bd3b-4f4a-ae78-c282d7849a57
Jul 31 12:23:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2161a0e8-a7a5-4af3-967f-a32c1277d7af tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.010s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-24e29865-b301-46da-b14b-3b90dd6a9d5a req-ca8f864d-5bed-4994-88b7-b0702d9f4c87 service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Received event network-vif-plugged-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-24e29865-b301-46da-b14b-3b90dd6a9d5a req-ca8f864d-5bed-4994-88b7-b0702d9f4c87 service nova] Acquiring lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-24e29865-b301-46da-b14b-3b90dd6a9d5a req-ca8f864d-5bed-4994-88b7-b0702d9f4c87 service nova] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-24e29865-b301-46da-b14b-3b90dd6a9d5a req-ca8f864d-5bed-4994-88b7-b0702d9f4c87 service nova] Lock "6958347e-bd3b-4f4a-ae78-c282d7849a57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-24e29865-b301-46da-b14b-3b90dd6a9d5a req-ca8f864d-5bed-4994-88b7-b0702d9f4c87 service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] No waiting events found dispatching network-vif-plugged-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:23:07 user nova-compute[72447]: WARNING nova.compute.manager [req-24e29865-b301-46da-b14b-3b90dd6a9d5a req-ca8f864d-5bed-4994-88b7-b0702d9f4c87 service nova] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Received unexpected event network-vif-plugged-e6e7b3ce-27ab-426c-ad51-5e09fe4741a0 for instance with vm_state deleted and task_state None.
Jul 31 12:23:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:23:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:23:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:23:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:23:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:20 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806185.7136455, 6958347e-bd3b-4f4a-ae78-c282d7849a57 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:23:20 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] VM Stopped (Lifecycle Event)
Jul 31 12:23:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-cdc10f09-d6f0-4906-8b17-1727ec24282b None None] [instance: 6958347e-bd3b-4f4a-ae78-c282d7849a57] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:23:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:23:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:23:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:23:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:23:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:22 user nova-compute[72447]: INFO nova.compute.manager [None req-de3b9975-588f-4e73-8a6f-d88e93f5f654 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Unrescuing
Jul 31 12:23:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-de3b9975-588f-4e73-8a6f-d88e93f5f654 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:23:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-de3b9975-588f-4e73-8a6f-d88e93f5f654 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquired lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:23:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-de3b9975-588f-4e73-8a6f-d88e93f5f654 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:23:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-de3b9975-588f-4e73-8a6f-d88e93f5f654 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updating instance_info_cache with network_info: [{"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:23:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-de3b9975-588f-4e73-8a6f-d88e93f5f654 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Releasing lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:23:23 user nova-compute[72447]: DEBUG nova.objects.instance [None req-de3b9975-588f-4e73-8a6f-d88e93f5f654 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'flavor' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:23:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-c8459115-4456-40ab-83a2-cb2d24bf1969 req-1b3bdb7e-2d69-44a7-a0cb-e74a19d1d8b6 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-unplugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c8459115-4456-40ab-83a2-cb2d24bf1969 req-1b3bdb7e-2d69-44a7-a0cb-e74a19d1d8b6 service nova] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c8459115-4456-40ab-83a2-cb2d24bf1969 req-1b3bdb7e-2d69-44a7-a0cb-e74a19d1d8b6 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c8459115-4456-40ab-83a2-cb2d24bf1969 req-1b3bdb7e-2d69-44a7-a0cb-e74a19d1d8b6 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-c8459115-4456-40ab-83a2-cb2d24bf1969 req-1b3bdb7e-2d69-44a7-a0cb-e74a19d1d8b6 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] No waiting events found dispatching network-vif-unplugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:23:23 user nova-compute[72447]: WARNING nova.compute.manager [req-c8459115-4456-40ab-83a2-cb2d24bf1969 req-1b3bdb7e-2d69-44a7-a0cb-e74a19d1d8b6 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received unexpected event network-vif-unplugged-8cdc2eae-9d44-4619-ad18-98196a439f15 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:23:24 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Instance destroyed successfully.
Jul 31 12:23:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-5ae64285-6db2-4c04-bd89-df8cf3af8d12 req-c7b49e95-aed3-4b12-88e3-1f025e7087c9 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5ae64285-6db2-4c04-bd89-df8cf3af8d12 req-c7b49e95-aed3-4b12-88e3-1f025e7087c9 service nova] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5ae64285-6db2-4c04-bd89-df8cf3af8d12 req-c7b49e95-aed3-4b12-88e3-1f025e7087c9 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5ae64285-6db2-4c04-bd89-df8cf3af8d12 req-c7b49e95-aed3-4b12-88e3-1f025e7087c9 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-5ae64285-6db2-4c04-bd89-df8cf3af8d12 req-c7b49e95-aed3-4b12-88e3-1f025e7087c9 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] No waiting events found dispatching network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:23:25 user nova-compute[72447]: WARNING nova.compute.manager [req-5ae64285-6db2-4c04-bd89-df8cf3af8d12 req-c7b49e95-aed3-4b12-88e3-1f025e7087c9 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received unexpected event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:23:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-5ae64285-6db2-4c04-bd89-df8cf3af8d12 req-c7b49e95-aed3-4b12-88e3-1f025e7087c9 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5ae64285-6db2-4c04-bd89-df8cf3af8d12 req-c7b49e95-aed3-4b12-88e3-1f025e7087c9 service nova] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5ae64285-6db2-4c04-bd89-df8cf3af8d12 req-c7b49e95-aed3-4b12-88e3-1f025e7087c9 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5ae64285-6db2-4c04-bd89-df8cf3af8d12 req-c7b49e95-aed3-4b12-88e3-1f025e7087c9 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-5ae64285-6db2-4c04-bd89-df8cf3af8d12 req-c7b49e95-aed3-4b12-88e3-1f025e7087c9 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] No waiting events found dispatching network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:23:25 user nova-compute[72447]: WARNING nova.compute.manager [req-5ae64285-6db2-4c04-bd89-df8cf3af8d12 req-c7b49e95-aed3-4b12-88e3-1f025e7087c9 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received unexpected event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:23:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-de3b9975-588f-4e73-8a6f-d88e93f5f654 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:23:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 483f6f7a-c61d-46dd-893b-29b80da3f54d due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:23:27 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806207.5077922, 483f6f7a-c61d-46dd-893b-29b80da3f54d => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:23:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] VM Resumed (Lifecycle Event)
Jul 31 12:23:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:23:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:23:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 12:23:27 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806207.5079515, 483f6f7a-c61d-46dd-893b-29b80da3f54d => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:23:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] VM Started (Lifecycle Event)
Jul 31 12:23:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:23:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:23:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-76f18fbb-8ec7-47fc-a449-148372bc09f8 req-e848075e-22ef-49e5-8354-fdfac619d1f5 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-76f18fbb-8ec7-47fc-a449-148372bc09f8 req-e848075e-22ef-49e5-8354-fdfac619d1f5 service nova] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-76f18fbb-8ec7-47fc-a449-148372bc09f8 req-e848075e-22ef-49e5-8354-fdfac619d1f5 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-76f18fbb-8ec7-47fc-a449-148372bc09f8 req-e848075e-22ef-49e5-8354-fdfac619d1f5 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-76f18fbb-8ec7-47fc-a449-148372bc09f8 req-e848075e-22ef-49e5-8354-fdfac619d1f5 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] No waiting events found dispatching network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:23:27 user nova-compute[72447]: WARNING nova.compute.manager [req-76f18fbb-8ec7-47fc-a449-148372bc09f8 req-e848075e-22ef-49e5-8354-fdfac619d1f5 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received unexpected event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 for instance with vm_state active and task_state None.
Jul 31 12:23:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-a3aa9150-b315-4339-b2f4-3876a2638ab3 req-61e04b83-92fa-452d-928f-9efa9962ea59 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Received event network-changed-ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-a3aa9150-b315-4339-b2f4-3876a2638ab3 req-61e04b83-92fa-452d-928f-9efa9962ea59 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Refreshing instance network info cache due to event network-changed-ab22b558-2e8f-481d-8c03-8d1294acd404. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:23:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a3aa9150-b315-4339-b2f4-3876a2638ab3 req-61e04b83-92fa-452d-928f-9efa9962ea59 service nova] Acquiring lock "refresh_cache-8b487325-3b50-4f3f-857c-62fd0a64a6c0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:23:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a3aa9150-b315-4339-b2f4-3876a2638ab3 req-61e04b83-92fa-452d-928f-9efa9962ea59 service nova] Acquired lock "refresh_cache-8b487325-3b50-4f3f-857c-62fd0a64a6c0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:23:28 user nova-compute[72447]: DEBUG nova.network.neutron [req-a3aa9150-b315-4339-b2f4-3876a2638ab3 req-61e04b83-92fa-452d-928f-9efa9962ea59 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Refreshing network info cache for port ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:23:29 user nova-compute[72447]: DEBUG nova.network.neutron [req-a3aa9150-b315-4339-b2f4-3876a2638ab3 req-61e04b83-92fa-452d-928f-9efa9962ea59 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Updated VIF entry in instance network info cache for port ab22b558-2e8f-481d-8c03-8d1294acd404. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:23:29 user nova-compute[72447]: DEBUG nova.network.neutron [req-a3aa9150-b315-4339-b2f4-3876a2638ab3 req-61e04b83-92fa-452d-928f-9efa9962ea59 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Updating instance_info_cache with network_info: [{"id": "ab22b558-2e8f-481d-8c03-8d1294acd404", "address": "fa:16:3e:34:09:9c", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab22b558-2e", "ovs_interfaceid": "ab22b558-2e8f-481d-8c03-8d1294acd404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:23:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a3aa9150-b315-4339-b2f4-3876a2638ab3 req-61e04b83-92fa-452d-928f-9efa9962ea59 service nova] Releasing lock "refresh_cache-8b487325-3b50-4f3f-857c-62fd0a64a6c0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:23:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:32 user nova-compute[72447]: DEBUG nova.objects.instance [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'flavor' on Instance uuid 8b487325-3b50-4f3f-857c-62fd0a64a6c0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:23:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:33 user nova-compute[72447]: INFO nova.compute.manager [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Attaching volume 3a198864-0301-4b44-8042-97ad20750078 to /dev/vdb
Jul 31 12:23:33 user nova-compute[72447]: DEBUG os_brick.utils [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c76b2a-9391-4410-89a6-8eeaae066fca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37b2c2b-146a-4ae4-8561-b7cb96a2fd91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b941fae4-2c09-4136-b1e3-2b6ac519c9df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d696b7b8-20e3-4ef4-ae16-74431839a7f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:23:33 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:23:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0ca25f-a8c5-4483-ae3d-3c9d78aa76d1]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG os_brick.utils [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:23:33 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Updating existing volume attachment record: f0d5b647-a9ba-4d99-8ed9-8687d6584aa1 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:23:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:34 user nova-compute[72447]: INFO nova.compute.manager [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Terminating instance
Jul 31 12:23:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:23:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-af663858-d80a-43da-9b4c-4808aa638706 req-79955f90-337d-4135-b647-fc61145e532e service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Received event network-vif-unplugged-d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af663858-d80a-43da-9b4c-4808aa638706 req-79955f90-337d-4135-b647-fc61145e532e service nova] Acquiring lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af663858-d80a-43da-9b4c-4808aa638706 req-79955f90-337d-4135-b647-fc61145e532e service nova] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-af663858-d80a-43da-9b4c-4808aa638706 req-79955f90-337d-4135-b647-fc61145e532e service nova] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-af663858-d80a-43da-9b4c-4808aa638706 req-79955f90-337d-4135-b647-fc61145e532e service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] No waiting events found dispatching network-vif-unplugged-d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-af663858-d80a-43da-9b4c-4808aa638706 req-79955f90-337d-4135-b647-fc61145e532e service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Received event network-vif-unplugged-d8a152be-ed59-426b-809c-cf7c2992844c for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Instance destroyed successfully.
Jul 31 12:23:35 user nova-compute[72447]: DEBUG nova.objects.instance [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lazy-loading 'resources' on Instance uuid fbcc2c79-e1c7-45bc-9d16-db05b1027732 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1220080915',display_name='tempest-VolumesAdminNegativeTest-server-1220080915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1220080915',id=27,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:21:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3110024c6d94eff885a84c59a01a85c',ramdisk_id='',reservation_id='r-3zdxb812',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-420445056',owner_user_name='tempest-VolumesAdminNegativeTest-420445056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:21:47Z,user_data=None,user_id='1ead2fe8321b41be8bfc78f2bd5a036b',uuid=fbcc2c79-e1c7-45bc-9d16-db05b1027732,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8a152be-ed59-426b-809c-cf7c2992844c", "address": "fa:16:3e:6e:6e:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a152be-ed", "ovs_interfaceid": "d8a152be-ed59-426b-809c-cf7c2992844c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Converting VIF {"id": "d8a152be-ed59-426b-809c-cf7c2992844c", "address": "fa:16:3e:6e:6e:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a152be-ed", "ovs_interfaceid": "d8a152be-ed59-426b-809c-cf7c2992844c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6e:27,bridge_name='br-int',has_traffic_filtering=True,id=d8a152be-ed59-426b-809c-cf7c2992844c,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a152be-ed') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG os_vif [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6e:27,bridge_name='br-int',has_traffic_filtering=True,id=d8a152be-ed59-426b-809c-cf7c2992844c,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a152be-ed') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8a152be-ed, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:23:35 user nova-compute[72447]: INFO os_vif [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6e:27,bridge_name='br-int',has_traffic_filtering=True,id=d8a152be-ed59-426b-809c-cf7c2992844c,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a152be-ed')
Jul 31 12:23:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Deleting instance files /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732_del
Jul 31 12:23:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Deletion of /opt/stack/data/nova/instances/fbcc2c79-e1c7-45bc-9d16-db05b1027732_del complete
Jul 31 12:23:35 user nova-compute[72447]: INFO nova.compute.manager [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Took 0.76 seconds to destroy the instance on the hypervisor.
Jul 31 12:23:35 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:23:35 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:23:36 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Took 0.53 seconds to deallocate network for instance.
Jul 31 12:23:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-f4aab26b-5cf8-4e0d-8adf-0ac790f0ab5d req-7d7299ce-5657-42c8-9ed0-461701987254 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Received event network-vif-deleted-d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:36 user nova-compute[72447]: INFO nova.compute.manager [req-f4aab26b-5cf8-4e0d-8adf-0ac790f0ab5d req-7d7299ce-5657-42c8-9ed0-461701987254 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Neutron deleted interface d8a152be-ed59-426b-809c-cf7c2992844c; detaching it from the instance and deleting it from the info cache
Jul 31 12:23:36 user nova-compute[72447]: DEBUG nova.network.neutron [req-f4aab26b-5cf8-4e0d-8adf-0ac790f0ab5d req-7d7299ce-5657-42c8-9ed0-461701987254 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:23:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-f4aab26b-5cf8-4e0d-8adf-0ac790f0ab5d req-7d7299ce-5657-42c8-9ed0-461701987254 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Detach interface failed, port_id=d8a152be-ed59-426b-809c-cf7c2992844c, reason: Instance fbcc2c79-e1c7-45bc-9d16-db05b1027732 could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:23:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:36 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:23:36 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:23:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:36 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Deleted allocations for instance fbcc2c79-e1c7-45bc-9d16-db05b1027732
Jul 31 12:23:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-8c27363c-25fe-4435-b8c6-bff7374c73eb tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.952s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-b516e37f-f24c-464f-9ff4-0870cc61fd89 req-5302eb6a-b95a-49ad-ba65-d1cef44fc164 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Received event network-vif-plugged-d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b516e37f-f24c-464f-9ff4-0870cc61fd89 req-5302eb6a-b95a-49ad-ba65-d1cef44fc164 service nova] Acquiring lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b516e37f-f24c-464f-9ff4-0870cc61fd89 req-5302eb6a-b95a-49ad-ba65-d1cef44fc164 service nova] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b516e37f-f24c-464f-9ff4-0870cc61fd89 req-5302eb6a-b95a-49ad-ba65-d1cef44fc164 service nova] Lock "fbcc2c79-e1c7-45bc-9d16-db05b1027732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-b516e37f-f24c-464f-9ff4-0870cc61fd89 req-5302eb6a-b95a-49ad-ba65-d1cef44fc164 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] No waiting events found dispatching network-vif-plugged-d8a152be-ed59-426b-809c-cf7c2992844c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:23:37 user nova-compute[72447]: WARNING nova.compute.manager [req-b516e37f-f24c-464f-9ff4-0870cc61fd89 req-5302eb6a-b95a-49ad-ba65-d1cef44fc164 service nova] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Received unexpected event network-vif-plugged-d8a152be-ed59-426b-809c-cf7c2992844c for instance with vm_state deleted and task_state None.
Jul 31 12:23:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "16a82016-d342-4a52-909f-45d363f9d8a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "16a82016-d342-4a52-909f-45d363f9d8a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:23:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:38 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:23:38 user nova-compute[72447]: INFO nova.compute.claims [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Claim successful on node user
Jul 31 12:23:38 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:23:38 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:23:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:23:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:23:38 user nova-compute[72447]: DEBUG nova.network.neutron [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:23:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:23:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG nova.policy [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c7a178f684246608fded95196469c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e21ac0a7354b85bcbe334edfc00fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG nova.compute.manager [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:23:39 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Creating image(s)
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "/opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "/opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "/opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk 1073741824" returned: 0 in 0.049s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.164s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG nova.network.neutron [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Successfully created port: ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Cannot resize image /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG nova.objects.instance [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lazy-loading 'migration_context' on Instance uuid 16a82016-d342-4a52-909f-45d363f9d8a8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Ensure instance console log exists: /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.network.neutron [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Successfully updated port: ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "refresh_cache-16a82016-d342-4a52-909f-45d363f9d8a8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquired lock "refresh_cache-16a82016-d342-4a52-909f-45d363f9d8a8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.network.neutron [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.compute.manager [req-870c69b3-76ef-4e6f-b0a8-2a34bde49ee9 req-ba21b023-a483-4203-9e7f-1cd698844500 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Received event network-changed-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.compute.manager [req-870c69b3-76ef-4e6f-b0a8-2a34bde49ee9 req-ba21b023-a483-4203-9e7f-1cd698844500 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Refreshing instance network info cache due to event network-changed-ffa9aabc-b8eb-4631-9ce1-0167b312ea32. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-870c69b3-76ef-4e6f-b0a8-2a34bde49ee9 req-ba21b023-a483-4203-9e7f-1cd698844500 service nova] Acquiring lock "refresh_cache-16a82016-d342-4a52-909f-45d363f9d8a8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.network.neutron [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.network.neutron [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Updating instance_info_cache with network_info: [{"id": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "address": "fa:16:3e:43:67:6f", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa9aabc-b8", "ovs_interfaceid": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Releasing lock "refresh_cache-16a82016-d342-4a52-909f-45d363f9d8a8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.compute.manager [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Instance network_info: |[{"id": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "address": "fa:16:3e:43:67:6f", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa9aabc-b8", "ovs_interfaceid": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-870c69b3-76ef-4e6f-b0a8-2a34bde49ee9 req-ba21b023-a483-4203-9e7f-1cd698844500 service nova] Acquired lock "refresh_cache-16a82016-d342-4a52-909f-45d363f9d8a8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.network.neutron [req-870c69b3-76ef-4e6f-b0a8-2a34bde49ee9 req-ba21b023-a483-4203-9e7f-1cd698844500 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Refreshing network info cache for port ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Start _get_guest_xml network_info=[{"id": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "address": "fa:16:3e:43:67:6f", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa9aabc-b8", "ovs_interfaceid": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:23:40 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:23:40 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1411583077',display_name='tempest-VolumesActionsTest-instance-1411583077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1411583077',id=30,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49e21ac0a7354b85bcbe334edfc00fd5',ramdisk_id='',reservation_id='r-zgjej41c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-489730423',owner_user_name='tempest-VolumesActionsTest-489730423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:23:39Z,user_data=None,user_id='1c7a178f684246608fded95196469c0f',uuid=16a82016-d342-4a52-909f-45d363f9d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "address": "fa:16:3e:43:67:6f", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa9aabc-b8", "ovs_interfaceid": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Converting VIF {"id": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "address": "fa:16:3e:43:67:6f", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa9aabc-b8", "ovs_interfaceid": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:67:6f,bridge_name='br-int',has_traffic_filtering=True,id=ffa9aabc-b8eb-4631-9ce1-0167b312ea32,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa9aabc-b8') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:23:40 user nova-compute[72447]: DEBUG nova.objects.instance [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lazy-loading 'pci_devices' on Instance uuid 16a82016-d342-4a52-909f-45d363f9d8a8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:23:41 user nova-compute[72447]:   <uuid>16a82016-d342-4a52-909f-45d363f9d8a8</uuid>
Jul 31 12:23:41 user nova-compute[72447]:   <name>instance-0000001e</name>
Jul 31 12:23:41 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:23:41 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:23:41 user nova-compute[72447]:   <metadata>
Jul 31 12:23:41 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:23:41 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:23:41 user nova-compute[72447]:       <nova:name>tempest-VolumesActionsTest-instance-1411583077</nova:name>
Jul 31 12:23:41 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:23:40</nova:creationTime>
Jul 31 12:23:41 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:23:41 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:23:41 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:23:41 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:23:41 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:23:41 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:23:41 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:23:41 user nova-compute[72447]:       <nova:owner>
Jul 31 12:23:41 user nova-compute[72447]:         <nova:user uuid="1c7a178f684246608fded95196469c0f">tempest-VolumesActionsTest-489730423-project-member</nova:user>
Jul 31 12:23:41 user nova-compute[72447]:         <nova:project uuid="49e21ac0a7354b85bcbe334edfc00fd5">tempest-VolumesActionsTest-489730423</nova:project>
Jul 31 12:23:41 user nova-compute[72447]:       </nova:owner>
Jul 31 12:23:41 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:23:41 user nova-compute[72447]:       <nova:ports>
Jul 31 12:23:41 user nova-compute[72447]:         <nova:port uuid="ffa9aabc-b8eb-4631-9ce1-0167b312ea32">
Jul 31 12:23:41 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 12:23:41 user nova-compute[72447]:         </nova:port>
Jul 31 12:23:41 user nova-compute[72447]:       </nova:ports>
Jul 31 12:23:41 user nova-compute[72447]:     </nova:instance>
Jul 31 12:23:41 user nova-compute[72447]:   </metadata>
Jul 31 12:23:41 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:23:41 user nova-compute[72447]:     <system>
Jul 31 12:23:41 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:23:41 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:23:41 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:23:41 user nova-compute[72447]:       <entry name="serial">16a82016-d342-4a52-909f-45d363f9d8a8</entry>
Jul 31 12:23:41 user nova-compute[72447]:       <entry name="uuid">16a82016-d342-4a52-909f-45d363f9d8a8</entry>
Jul 31 12:23:41 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:23:41 user nova-compute[72447]:     </system>
Jul 31 12:23:41 user nova-compute[72447]:   </sysinfo>
Jul 31 12:23:41 user nova-compute[72447]:   <os>
Jul 31 12:23:41 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:23:41 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:23:41 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:23:41 user nova-compute[72447]:   </os>
Jul 31 12:23:41 user nova-compute[72447]:   <features>
Jul 31 12:23:41 user nova-compute[72447]:     <acpi/>
Jul 31 12:23:41 user nova-compute[72447]:     <apic/>
Jul 31 12:23:41 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:23:41 user nova-compute[72447]:   </features>
Jul 31 12:23:41 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:23:41 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:23:41 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:23:41 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:23:41 user nova-compute[72447]:   </clock>
Jul 31 12:23:41 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:23:41 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:23:41 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:23:41 user nova-compute[72447]:   </cpu>
Jul 31 12:23:41 user nova-compute[72447]:   <devices>
Jul 31 12:23:41 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:23:41 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:23:41 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk"/>
Jul 31 12:23:41 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:23:41 user nova-compute[72447]:     </disk>
Jul 31 12:23:41 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:23:41 user nova-compute[72447]:       <mac address="fa:16:3e:43:67:6f"/>
Jul 31 12:23:41 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:23:41 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:23:41 user nova-compute[72447]:       <target dev="tapffa9aabc-b8"/>
Jul 31 12:23:41 user nova-compute[72447]:     </interface>
Jul 31 12:23:41 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:23:41 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/console.log" append="off"/>
Jul 31 12:23:41 user nova-compute[72447]:     </serial>
Jul 31 12:23:41 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:23:41 user nova-compute[72447]:     <video>
Jul 31 12:23:41 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:23:41 user nova-compute[72447]:     </video>
Jul 31 12:23:41 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:23:41 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:23:41 user nova-compute[72447]:     </rng>
Jul 31 12:23:41 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:23:41 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:23:41 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:23:41 user nova-compute[72447]:     </memballoon>
Jul 31 12:23:41 user nova-compute[72447]:   </devices>
Jul 31 12:23:41 user nova-compute[72447]: </domain>
Jul 31 12:23:41 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1411583077',display_name='tempest-VolumesActionsTest-instance-1411583077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1411583077',id=30,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49e21ac0a7354b85bcbe334edfc00fd5',ramdisk_id='',reservation_id='r-zgjej41c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-489730423',owner_user_name='tempest-VolumesActionsTest-489730423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:23:39Z,user_data=None,user_id='1c7a178f684246608fded95196469c0f',uuid=16a82016-d342-4a52-909f-45d363f9d8a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "address": "fa:16:3e:43:67:6f", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa9aabc-b8", "ovs_interfaceid": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Converting VIF {"id": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "address": "fa:16:3e:43:67:6f", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa9aabc-b8", "ovs_interfaceid": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:67:6f,bridge_name='br-int',has_traffic_filtering=True,id=ffa9aabc-b8eb-4631-9ce1-0167b312ea32,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa9aabc-b8') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_vif [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:67:6f,bridge_name='br-int',has_traffic_filtering=True,id=ffa9aabc-b8eb-4631-9ce1-0167b312ea32,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa9aabc-b8') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffa9aabc-b8, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapffa9aabc-b8, col_values=(('external_ids', {'iface-id': 'ffa9aabc-b8eb-4631-9ce1-0167b312ea32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:67:6f', 'vm-uuid': '16a82016-d342-4a52-909f-45d363f9d8a8'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:41 user nova-compute[72447]: INFO os_vif [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:67:6f,bridge_name='br-int',has_traffic_filtering=True,id=ffa9aabc-b8eb-4631-9ce1-0167b312ea32,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa9aabc-b8')
Jul 31 12:23:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] No VIF found with MAC fa:16:3e:43:67:6f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxDsIPUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:23:41 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:23:41 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:23:41 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ab6a62-4774-489a-b683-c8f0bed963d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:23:41 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0761ef-7d9b-449c-b489-868dc27e5eff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078] added
Jul 31 12:23:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f807f78b-6f38-4c88-8bf6-0073f47f144a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6b3416-1af5-4691-ae20-fc21855b6bc0]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NxDsIPUj {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NxDsIPUj" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2236dbe6-3aca-4c98-93b2-746136bb6c56]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NxDsIPUj'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[860aaf96-9186-45d0-9d69-213f31948dc7]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c742ceed-4693-4ab6-8f47-cb5b3c557ff8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:23:41 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:23:41 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:23:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:23:41 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:23:41 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:23:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74e8331-3292-4599-bf60-247a69a381f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078, portal: 172.16.0.220,3260]
Jul 31 12:23:41 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078, portal: 172.16.0.220,3260] successful.
Jul 31 12:23:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8be9b22-e591-429d-9185-e019fce49d6c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG nova.network.neutron [req-870c69b3-76ef-4e6f-b0a8-2a34bde49ee9 req-ba21b023-a483-4203-9e7f-1cd698844500 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Updated VIF entry in instance network info cache for port ffa9aabc-b8eb-4631-9ce1-0167b312ea32. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG nova.network.neutron [req-870c69b3-76ef-4e6f-b0a8-2a34bde49ee9 req-ba21b023-a483-4203-9e7f-1cd698844500 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Updating instance_info_cache with network_info: [{"id": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "address": "fa:16:3e:43:67:6f", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa9aabc-b8", "ovs_interfaceid": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-870c69b3-76ef-4e6f-b0a8-2a34bde49ee9 req-ba21b023-a483-4203-9e7f-1cd698844500 service nova] Releasing lock "refresh_cache-16a82016-d342-4a52-909f-45d363f9d8a8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[25562bc8-87ea-407a-be16-309d3e9e8abd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:23:41 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:23:41 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:23:41 user nova-compute[72447]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 (non-flash)
Jul 31 12:23:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:23:41 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:23:41 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:23:41 user nova-compute[72447]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 (non-flash)
Jul 31 12:23:41 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3200826-8e2d-479b-99a8-74ce731290e1]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:23:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxDsIPUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26435663739353461', 'path': '/dev/sde'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435663739353461', 'path': '/dev/sde'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-9cabc012-d419-4242-8183-c3e240b9a12a req-73ff5527-2994-4104-a404-13eed8f90098 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Received event network-vif-plugged-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9cabc012-d419-4242-8183-c3e240b9a12a req-73ff5527-2994-4104-a404-13eed8f90098 service nova] Acquiring lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9cabc012-d419-4242-8183-c3e240b9a12a req-73ff5527-2994-4104-a404-13eed8f90098 service nova] Lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9cabc012-d419-4242-8183-c3e240b9a12a req-73ff5527-2994-4104-a404-13eed8f90098 service nova] Lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-9cabc012-d419-4242-8183-c3e240b9a12a req-73ff5527-2994-4104-a404-13eed8f90098 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] No waiting events found dispatching network-vif-plugged-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:23:42 user nova-compute[72447]: WARNING nova.compute.manager [req-9cabc012-d419-4242-8183-c3e240b9a12a req-73ff5527-2994-4104-a404-13eed8f90098 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Received unexpected event network-vif-plugged-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 for instance with vm_state building and task_state spawning.
Jul 31 12:23:42 user nova-compute[72447]: DEBUG nova.objects.instance [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'flavor' on Instance uuid 8b487325-3b50-4f3f-857c-62fd0a64a6c0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:23:42 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:23:42 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:23:42 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:23:42 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:23:42 user nova-compute[72447]:   <serial>3a198864-0301-4b44-8042-97ad20750078</serial>
Jul 31 12:23:42 user nova-compute[72447]: </disk>
Jul 31 12:23:42 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:23:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:23:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:23:43 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] No VIF found with MAC fa:16:3e:34:09:9c, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:23:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-56cd8869-b084-4ef3-9d52-ec85d1f2d406 tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.336s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:44 user nova-compute[72447]: INFO nova.compute.manager [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Detaching volume 3a198864-0301-4b44-8042-97ad20750078
Jul 31 12:23:44 user nova-compute[72447]: INFO nova.virt.block_device [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Attempting to driver detach volume 3a198864-0301-4b44-8042-97ad20750078 from mountpoint /dev/vdb
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Attempting to detach device vdb from instance 8b487325-3b50-4f3f-857c-62fd0a64a6c0 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:23:44 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:23:44 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:23:44 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:23:44 user nova-compute[72447]:   <serial>3a198864-0301-4b44-8042-97ad20750078</serial>
Jul 31 12:23:44 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:23:44 user nova-compute[72447]: </disk>
Jul 31 12:23:44 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:23:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully detached device vdb from instance 8b487325-3b50-4f3f-857c-62fd0a64a6c0 from the persistent domain config.
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8b487325-3b50-4f3f-857c-62fd0a64a6c0 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:23:44 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:23:44 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:23:44 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:23:44 user nova-compute[72447]:   <serial>3a198864-0301-4b44-8042-97ad20750078</serial>
Jul 31 12:23:44 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:23:44 user nova-compute[72447]: </disk>
Jul 31 12:23:44 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806224.6922393, 8b487325-3b50-4f3f-857c-62fd0a64a6c0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8b487325-3b50-4f3f-857c-62fd0a64a6c0 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:23:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully detached device vdb from instance 8b487325-3b50-4f3f-857c-62fd0a64a6c0 from the live domain config.
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxDsIPUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:23:44 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cd8dc2-f21c-48dd-8945-9249d878a424]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6800115-6c14-4cd4-bfda-cec60a9d5490]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:23:44 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:23:44 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:23:44 user nova-compute[72447]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 (non-flash)
Jul 31 12:23:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:23:44 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:23:44 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:23:44 user nova-compute[72447]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 (non-flash)
Jul 31 12:23:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f064876a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078'): ({'sde'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Removing single pathed devices sde {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0a7561-1aff-4644-83af-7fc343682ce6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-845badee-3f28-4244-a0ac-ebb372193d71 req-dae0daef-f03d-4cce-b550-2e67a9c94d59 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Received event network-vif-plugged-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-845badee-3f28-4244-a0ac-ebb372193d71 req-dae0daef-f03d-4cce-b550-2e67a9c94d59 service nova] Acquiring lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-845badee-3f28-4244-a0ac-ebb372193d71 req-dae0daef-f03d-4cce-b550-2e67a9c94d59 service nova] Lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-845badee-3f28-4244-a0ac-ebb372193d71 req-dae0daef-f03d-4cce-b550-2e67a9c94d59 service nova] Lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-845badee-3f28-4244-a0ac-ebb372193d71 req-dae0daef-f03d-4cce-b550-2e67a9c94d59 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] No waiting events found dispatching network-vif-plugged-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:23:44 user nova-compute[72447]: WARNING nova.compute.manager [req-845badee-3f28-4244-a0ac-ebb372193d71 req-dae0daef-f03d-4cce-b550-2e67a9c94d59 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Received unexpected event network-vif-plugged-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 for instance with vm_state building and task_state spawning.
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[968fb5c6-173d-454c-9b9d-9323d45e46c5]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Flushing IO for device /dev/sde {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[36061fdc-3bd8-45b6-9d87-3c3660b0e229]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f1085f-7748-4c1c-b899-48f5f7b4d482]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806224.8820214, 16a82016-d342-4a52-909f-45d363f9d8a8 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:23:44 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] VM Resumed (Lifecycle Event)
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87dd7a7-f886-4dc2-926a-6b7858d0e2be]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Instance spawned successfully.
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:23:44 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806224.883335, 16a82016-d342-4a52-909f-45d363f9d8a8 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:23:44 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] VM Started (Lifecycle Event)
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aeb11f6-4aea-4c80-8b74-5e770b41b8c5]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078, portal: 172.16.0.220,3260]
Jul 31 12:23:44 user nova-compute[72447]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078, portal: 172.16.0.220,3260] successful.
Jul 31 12:23:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:23:44 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a198864-0301-4b44-8042-97ad20750078 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bb41eb-50d4-4949-8497-f7ad366e388b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:23:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:23:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] <== disconnect_volume: return (295ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:23:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:23:45 user nova-compute[72447]: INFO nova.compute.manager [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Took 5.96 seconds to spawn the instance on the hypervisor.
Jul 31 12:23:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:23:45 user nova-compute[72447]: INFO nova.compute.manager [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Took 6.81 seconds to build instance.
Jul 31 12:23:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cdaa7fb1-bd0f-4964-a1ca-301e92662d8f tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "16a82016-d342-4a52-909f-45d363f9d8a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.914s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:45 user nova-compute[72447]: DEBUG nova.objects.instance [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'flavor' on Instance uuid 8b487325-3b50-4f3f-857c-62fd0a64a6c0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:23:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9e17cba5-e634-4771-b6b0-c889cebad33b tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.603s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:23:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:50 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806215.3472278, fbcc2c79-e1c7-45bc-9d16-db05b1027732 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:23:50 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] VM Stopped (Lifecycle Event)
Jul 31 12:23:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-36d21252-329b-4c9b-9f7a-a9fe860036d3 None None] [instance: fbcc2c79-e1c7-45bc-9d16-db05b1027732] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:23:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:23:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:23:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:23:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:23:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:23:52 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:23:52 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:23:52 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updating instance_info_cache with network_info: [{"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:23:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-981b694a-bf63-4f4b-95c5-bc17aa72b87b" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:23:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:23:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:55 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:23:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:23:56 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:23:56 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:23:56 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:23:56 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:23:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:24:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:04 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:24:04 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=6929MB free_disk=25.006282806396484GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b291ba57-9fdb-48f2-ac0c-45a108dda3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b5fe9835-8278-449e-9069-18421cb088dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 483f6f7a-c61d-46dd-893b-29b80da3f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 92ff498b-1337-47da-aaf1-b5fb9f19e98d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 8b487325-3b50-4f3f-857c-62fd0a64a6c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 87220d5b-df7b-4664-a5e8-088157130701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 16a82016-d342-4a52-909f-45d363f9d8a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:24:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:05 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:24:05 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:24:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:24:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "87220d5b-df7b-4664-a5e8-088157130701" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:06 user nova-compute[72447]: INFO nova.compute.manager [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Terminating instance
Jul 31 12:24:06 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:24:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1a83dcb-b717-4af7-b7e6-2c7b2d3afff7 req-eede2349-761a-4b09-b09a-318e36fa29e1 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-vif-unplugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1a83dcb-b717-4af7-b7e6-2c7b2d3afff7 req-eede2349-761a-4b09-b09a-318e36fa29e1 service nova] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1a83dcb-b717-4af7-b7e6-2c7b2d3afff7 req-eede2349-761a-4b09-b09a-318e36fa29e1 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1a83dcb-b717-4af7-b7e6-2c7b2d3afff7 req-eede2349-761a-4b09-b09a-318e36fa29e1 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1a83dcb-b717-4af7-b7e6-2c7b2d3afff7 req-eede2349-761a-4b09-b09a-318e36fa29e1 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] No waiting events found dispatching network-vif-unplugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1a83dcb-b717-4af7-b7e6-2c7b2d3afff7 req-eede2349-761a-4b09-b09a-318e36fa29e1 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-vif-unplugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:24:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Instance destroyed successfully.
Jul 31 12:24:07 user nova-compute[72447]: DEBUG nova.objects.instance [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lazy-loading 'resources' on Instance uuid 87220d5b-df7b-4664-a5e8-088157130701 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1809185140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1809185140',id=21,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsjkp3AZodxtBxsAt/VOiQNsOssof0791bnDw6kXo1qalLZuixWZDfUdE+7iSVjIKO/vnIxlJCZuB5Blyb4/Bx18cIDvjWLFw43QhuekDLT5oFcsVtn2OfEKnZpzCXqjA==',key_name='tempest-keypair-1672108798',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8dd0d543cb4786afc39e88f440e538',ramdisk_id='',reservation_id='r-fx3n0x08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1971436108',owner_user_name='tempest-AttachVolumeShelveTestJSON-1971436108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc465160a3a94498ab1aa3aa44280b12',uuid=87220d5b-df7b-4664-a5e8-088157130701,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converting VIF {"id": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "address": "fa:16:3e:34:5b:8d", "network": {"id": "a2c59212-c0dd-4cda-9fdf-0f4df844ff59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-725055003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8dd0d543cb4786afc39e88f440e538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf8adb7-88", "ovs_interfaceid": "fcf8adb7-881f-403d-bc7b-27a782db1dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG os_vif [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcf8adb7-88, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:07 user nova-compute[72447]: INFO os_vif [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=fcf8adb7-881f-403d-bc7b-27a782db1dd5,network=Network(a2c59212-c0dd-4cda-9fdf-0f4df844ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf8adb7-88')
Jul 31 12:24:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Deleting instance files /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701_del
Jul 31 12:24:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Deletion of /opt/stack/data/nova/instances/87220d5b-df7b-4664-a5e8-088157130701_del complete
Jul 31 12:24:07 user nova-compute[72447]: INFO nova.compute.manager [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 31 12:24:07 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:24:07 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 87220d5b-df7b-4664-a5e8-088157130701] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:24:08 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:24:08 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Took 0.77 seconds to deallocate network for instance.
Jul 31 12:24:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:08 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:24:08 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:24:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:08 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Deleted allocations for instance 87220d5b-df7b-4664-a5e8-088157130701
Jul 31 12:24:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c0a49e68-5a16-4d6d-8cf5-6d2024d4d29f tempest-AttachVolumeShelveTestJSON-1971436108 tempest-AttachVolumeShelveTestJSON-1971436108-project-member] Lock "87220d5b-df7b-4664-a5e8-088157130701" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.198s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-b75c3686-b8ed-43ac-b36a-60f4a9655278 req-ae0a13cf-f9b2-4ca6-9da3-3d8f621e7eb1 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b75c3686-b8ed-43ac-b36a-60f4a9655278 req-ae0a13cf-f9b2-4ca6-9da3-3d8f621e7eb1 service nova] Acquiring lock "87220d5b-df7b-4664-a5e8-088157130701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b75c3686-b8ed-43ac-b36a-60f4a9655278 req-ae0a13cf-f9b2-4ca6-9da3-3d8f621e7eb1 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b75c3686-b8ed-43ac-b36a-60f4a9655278 req-ae0a13cf-f9b2-4ca6-9da3-3d8f621e7eb1 service nova] Lock "87220d5b-df7b-4664-a5e8-088157130701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-b75c3686-b8ed-43ac-b36a-60f4a9655278 req-ae0a13cf-f9b2-4ca6-9da3-3d8f621e7eb1 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] No waiting events found dispatching network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:09 user nova-compute[72447]: WARNING nova.compute.manager [req-b75c3686-b8ed-43ac-b36a-60f4a9655278 req-ae0a13cf-f9b2-4ca6-9da3-3d8f621e7eb1 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received unexpected event network-vif-plugged-fcf8adb7-881f-403d-bc7b-27a782db1dd5 for instance with vm_state deleted and task_state None.
Jul 31 12:24:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-b75c3686-b8ed-43ac-b36a-60f4a9655278 req-ae0a13cf-f9b2-4ca6-9da3-3d8f621e7eb1 service nova] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Received event network-vif-deleted-fcf8adb7-881f-403d-bc7b-27a782db1dd5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "f3f1534b-16c0-4dee-b78c-d53713113a64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:24:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:20 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:24:20 user nova-compute[72447]: INFO nova.compute.claims [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Claim successful on node user
Jul 31 12:24:21 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG nova.network.neutron [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:24:21 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:24:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG nova.policy [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33268392189342ecbca53c9ad959245e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a055fae579aa4858867824625e8bd18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:24:21 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Creating image(s)
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "/opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "/opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk 1073741824" returned: 0 in 0.048s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.130s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:24:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Cannot resize image /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.objects.instance [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'migration_context' on Instance uuid f3f1534b-16c0-4dee-b78c-d53713113a64 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Ensure instance console log exists: /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Successfully created port: 580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.objects.instance [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'flavor' on Instance uuid 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806247.6244535, 87220d5b-df7b-4664-a5e8-088157130701 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:24:22 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 87220d5b-df7b-4664-a5e8-088157130701] VM Stopped (Lifecycle Event)
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-640aedef-93af-4c1e-8aef-deb427bbb795 None None] [instance: 87220d5b-df7b-4664-a5e8-088157130701] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:22 user nova-compute[72447]: INFO nova.compute.manager [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Attaching volume f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 to /dev/vdb
Jul 31 12:24:22 user nova-compute[72447]: DEBUG os_brick.utils [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[da76a030-01aa-48d0-9563-47f1d9f17a6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5749bf7-ff51-425a-9632-5a982d911e50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9d4bcc-c196-49d3-9329-ce434476dedd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0c393a-bd56-4c1a-a130-09f44e8632f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Successfully updated port: 580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:24:22 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0402ff8f-0d90-4114-979f-0904b77f24f6]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG os_brick.utils [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updating existing volume attachment record: 9d2e48d1-4ff6-43ae-87c8-6c0682d3c241 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "refresh_cache-f3f1534b-16c0-4dee-b78c-d53713113a64" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquired lock "refresh_cache-f3f1534b-16c0-4dee-b78c-d53713113a64" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.compute.manager [req-b4d3cb9b-2287-4354-9710-9a5d761eb541 req-244b155e-a2c1-45f6-a577-a391971d98c6 service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Received event network-changed-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG nova.compute.manager [req-b4d3cb9b-2287-4354-9710-9a5d761eb541 req-244b155e-a2c1-45f6-a577-a391971d98c6 service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Refreshing instance network info cache due to event network-changed-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:24:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b4d3cb9b-2287-4354-9710-9a5d761eb541 req-244b155e-a2c1-45f6-a577-a391971d98c6 service nova] Acquiring lock "refresh_cache-f3f1534b-16c0-4dee-b78c-d53713113a64" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Updating instance_info_cache with network_info: [{"id": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "address": "fa:16:3e:20:3c:9e", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580d2fc9-3b", "ovs_interfaceid": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Releasing lock "refresh_cache-f3f1534b-16c0-4dee-b78c-d53713113a64" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.compute.manager [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Instance network_info: |[{"id": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "address": "fa:16:3e:20:3c:9e", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580d2fc9-3b", "ovs_interfaceid": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b4d3cb9b-2287-4354-9710-9a5d761eb541 req-244b155e-a2c1-45f6-a577-a391971d98c6 service nova] Acquired lock "refresh_cache-f3f1534b-16c0-4dee-b78c-d53713113a64" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.network.neutron [req-b4d3cb9b-2287-4354-9710-9a5d761eb541 req-244b155e-a2c1-45f6-a577-a391971d98c6 service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Refreshing network info cache for port 580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Start _get_guest_xml network_info=[{"id": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "address": "fa:16:3e:20:3c:9e", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580d2fc9-3b", "ovs_interfaceid": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:24:23 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:24:23 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-377701257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-377701257',id=31,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-sbtabmz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:24:21Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=f3f1534b-16c0-4dee-b78c-d53713113a64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "address": "fa:16:3e:20:3c:9e", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580d2fc9-3b", "ovs_interfaceid": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "address": "fa:16:3e:20:3c:9e", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580d2fc9-3b", "ovs_interfaceid": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=580d2fc9-3bdb-40d4-9630-c211b3e3cd3e,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580d2fc9-3b') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.objects.instance [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'pci_devices' on Instance uuid f3f1534b-16c0-4dee-b78c-d53713113a64 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:24:23 user nova-compute[72447]:   <uuid>f3f1534b-16c0-4dee-b78c-d53713113a64</uuid>
Jul 31 12:24:23 user nova-compute[72447]:   <name>instance-0000001f</name>
Jul 31 12:24:23 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:24:23 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:24:23 user nova-compute[72447]:   <metadata>
Jul 31 12:24:23 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:24:23 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:24:23 user nova-compute[72447]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-377701257</nova:name>
Jul 31 12:24:23 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:24:23</nova:creationTime>
Jul 31 12:24:23 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:24:23 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:24:23 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:24:23 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:24:23 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:24:23 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:24:23 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:24:23 user nova-compute[72447]:       <nova:owner>
Jul 31 12:24:23 user nova-compute[72447]:         <nova:user uuid="33268392189342ecbca53c9ad959245e">tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member</nova:user>
Jul 31 12:24:23 user nova-compute[72447]:         <nova:project uuid="a055fae579aa4858867824625e8bd18d">tempest-ServerBootFromVolumeStableRescueTest-1637857313</nova:project>
Jul 31 12:24:23 user nova-compute[72447]:       </nova:owner>
Jul 31 12:24:23 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:24:23 user nova-compute[72447]:       <nova:ports>
Jul 31 12:24:23 user nova-compute[72447]:         <nova:port uuid="580d2fc9-3bdb-40d4-9630-c211b3e3cd3e">
Jul 31 12:24:23 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 12:24:23 user nova-compute[72447]:         </nova:port>
Jul 31 12:24:23 user nova-compute[72447]:       </nova:ports>
Jul 31 12:24:23 user nova-compute[72447]:     </nova:instance>
Jul 31 12:24:23 user nova-compute[72447]:   </metadata>
Jul 31 12:24:23 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:24:23 user nova-compute[72447]:     <system>
Jul 31 12:24:23 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:24:23 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:24:23 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:24:23 user nova-compute[72447]:       <entry name="serial">f3f1534b-16c0-4dee-b78c-d53713113a64</entry>
Jul 31 12:24:23 user nova-compute[72447]:       <entry name="uuid">f3f1534b-16c0-4dee-b78c-d53713113a64</entry>
Jul 31 12:24:23 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:24:23 user nova-compute[72447]:     </system>
Jul 31 12:24:23 user nova-compute[72447]:   </sysinfo>
Jul 31 12:24:23 user nova-compute[72447]:   <os>
Jul 31 12:24:23 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:24:23 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:24:23 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:24:23 user nova-compute[72447]:   </os>
Jul 31 12:24:23 user nova-compute[72447]:   <features>
Jul 31 12:24:23 user nova-compute[72447]:     <acpi/>
Jul 31 12:24:23 user nova-compute[72447]:     <apic/>
Jul 31 12:24:23 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:24:23 user nova-compute[72447]:   </features>
Jul 31 12:24:23 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:24:23 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:24:23 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:24:23 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:24:23 user nova-compute[72447]:   </clock>
Jul 31 12:24:23 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:24:23 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:24:23 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:24:23 user nova-compute[72447]:   </cpu>
Jul 31 12:24:23 user nova-compute[72447]:   <devices>
Jul 31 12:24:23 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:24:23 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:24:23 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk"/>
Jul 31 12:24:23 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:24:23 user nova-compute[72447]:     </disk>
Jul 31 12:24:23 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:24:23 user nova-compute[72447]:       <mac address="fa:16:3e:20:3c:9e"/>
Jul 31 12:24:23 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:24:23 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:24:23 user nova-compute[72447]:       <target dev="tap580d2fc9-3b"/>
Jul 31 12:24:23 user nova-compute[72447]:     </interface>
Jul 31 12:24:23 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:24:23 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/console.log" append="off"/>
Jul 31 12:24:23 user nova-compute[72447]:     </serial>
Jul 31 12:24:23 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:24:23 user nova-compute[72447]:     <video>
Jul 31 12:24:23 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:24:23 user nova-compute[72447]:     </video>
Jul 31 12:24:23 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:24:23 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:24:23 user nova-compute[72447]:     </rng>
Jul 31 12:24:23 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:24:23 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:24:23 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:24:23 user nova-compute[72447]:     </memballoon>
Jul 31 12:24:23 user nova-compute[72447]:   </devices>
Jul 31 12:24:23 user nova-compute[72447]: </domain>
Jul 31 12:24:23 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-377701257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-377701257',id=31,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-sbtabmz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:24:21Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=f3f1534b-16c0-4dee-b78c-d53713113a64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "address": "fa:16:3e:20:3c:9e", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580d2fc9-3b", "ovs_interfaceid": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "address": "fa:16:3e:20:3c:9e", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580d2fc9-3b", "ovs_interfaceid": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=580d2fc9-3bdb-40d4-9630-c211b3e3cd3e,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580d2fc9-3b') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG os_vif [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=580d2fc9-3bdb-40d4-9630-c211b3e3cd3e,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580d2fc9-3b') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap580d2fc9-3b, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap580d2fc9-3b, col_values=(('external_ids', {'iface-id': '580d2fc9-3bdb-40d4-9630-c211b3e3cd3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:3c:9e', 'vm-uuid': 'f3f1534b-16c0-4dee-b78c-d53713113a64'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:23 user nova-compute[72447]: INFO os_vif [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=580d2fc9-3bdb-40d4-9630-c211b3e3cd3e,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580d2fc9-3b')
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No VIF found with MAC fa:16:3e:20:3c:9e, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.network.neutron [req-b4d3cb9b-2287-4354-9710-9a5d761eb541 req-244b155e-a2c1-45f6-a577-a391971d98c6 service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Updated VIF entry in instance network info cache for port 580d2fc9-3bdb-40d4-9630-c211b3e3cd3e. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG nova.network.neutron [req-b4d3cb9b-2287-4354-9710-9a5d761eb541 req-244b155e-a2c1-45f6-a577-a391971d98c6 service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Updating instance_info_cache with network_info: [{"id": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "address": "fa:16:3e:20:3c:9e", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580d2fc9-3b", "ovs_interfaceid": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:24:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b4d3cb9b-2287-4354-9710-9a5d761eb541 req-244b155e-a2c1-45f6-a577-a391971d98c6 service nova] Releasing lock "refresh_cache-f3f1534b-16c0-4dee-b78c-d53713113a64" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:24:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-ec1ad12a-f724-4f83-9b9f-09a6f11f9aee req-0e68e290-0916-4dad-a563-702ca26c309f service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Received event network-vif-plugged-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ec1ad12a-f724-4f83-9b9f-09a6f11f9aee req-0e68e290-0916-4dad-a563-702ca26c309f service nova] Acquiring lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ec1ad12a-f724-4f83-9b9f-09a6f11f9aee req-0e68e290-0916-4dad-a563-702ca26c309f service nova] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ec1ad12a-f724-4f83-9b9f-09a6f11f9aee req-0e68e290-0916-4dad-a563-702ca26c309f service nova] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-ec1ad12a-f724-4f83-9b9f-09a6f11f9aee req-0e68e290-0916-4dad-a563-702ca26c309f service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] No waiting events found dispatching network-vif-plugged-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:25 user nova-compute[72447]: WARNING nova.compute.manager [req-ec1ad12a-f724-4f83-9b9f-09a6f11f9aee req-0e68e290-0916-4dad-a563-702ca26c309f service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Received unexpected event network-vif-plugged-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e for instance with vm_state building and task_state spawning.
Jul 31 12:24:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:26 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806266.9829452, f3f1534b-16c0-4dee-b78c-d53713113a64 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:24:26 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] VM Resumed (Lifecycle Event)
Jul 31 12:24:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:24:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:24:26 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Instance spawned successfully.
Jul 31 12:24:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:24:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806266.9885547, f3f1534b-16c0-4dee-b78c-d53713113a64 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:24:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] VM Started (Lifecycle Event)
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-4cfbf714-eb33-4e4d-8782-8be91dc7e0c5 req-4dd90f8f-3e83-4565-afff-17d032737994 service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Received event network-vif-plugged-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4cfbf714-eb33-4e4d-8782-8be91dc7e0c5 req-4dd90f8f-3e83-4565-afff-17d032737994 service nova] Acquiring lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4cfbf714-eb33-4e4d-8782-8be91dc7e0c5 req-4dd90f8f-3e83-4565-afff-17d032737994 service nova] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4cfbf714-eb33-4e4d-8782-8be91dc7e0c5 req-4dd90f8f-3e83-4565-afff-17d032737994 service nova] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-4cfbf714-eb33-4e4d-8782-8be91dc7e0c5 req-4dd90f8f-3e83-4565-afff-17d032737994 service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] No waiting events found dispatching network-vif-plugged-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:27 user nova-compute[72447]: WARNING nova.compute.manager [req-4cfbf714-eb33-4e4d-8782-8be91dc7e0c5 req-4dd90f8f-3e83-4565-afff-17d032737994 service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Received unexpected event network-vif-plugged-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e for instance with vm_state building and task_state spawning.
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:24:27 user nova-compute[72447]: INFO nova.compute.manager [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Took 5.65 seconds to spawn the instance on the hypervisor.
Jul 31 12:24:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:24:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:24:27 user nova-compute[72447]: INFO nova.compute.manager [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Took 6.44 seconds to build instance.
Jul 31 12:24:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-066489cd-a975-4d85-9ec4-a76aaa712f67 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.530s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnPtrNkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:24:30 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:24:30 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:24:30 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb0ff25-089e-4eb2-bd31-1c1448ec76b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:24:30 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9652f4-a01f-4611-807e-d9cb6eba8fa3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16] added
Jul 31 12:24:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69049b7-6e4f-4c01-a8c2-0cc487f394d5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbcff6f-ff40-4831-a130-49155438fcfa]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnPtrNkI {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnPtrNkI" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3aafe0-abb1-41d3-b520-c7cb444aa1f3]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LnPtrNkI'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3529fd-15f0-4e6f-a128-8e572dfd1c43]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bae95ec-cb0c-4c25-8940-a56af8aea99a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:24:30 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:24:30 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:24:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:24:30 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:24:30 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:24:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec36c2e5-6f9d-4641-a2ac-8064d733590d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16, portal: 172.16.0.220,3260]
Jul 31 12:24:30 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16, portal: 172.16.0.220,3260] successful.
Jul 31 12:24:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6565c710-c3c7-40c7-89fb-ad388e752a67]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab1eed5-f3fd-4c83-b4c6-2c4ca12d7d28]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:24:30 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:24:30 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:24:30 user nova-compute[72447]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)
Jul 31 12:24:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:24:30 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:24:30 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:24:30 user nova-compute[72447]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)
Jul 31 12:24:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[536f2ed2-9c84-4465-8389-67502905b5b4]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:24:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnPtrNkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:24:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:24:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23466363238633637', 'path': '/dev/sde'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:24:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466363238633637', 'path': '/dev/sde'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:24:31 user nova-compute[72447]: DEBUG nova.objects.instance [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'flavor' on Instance uuid 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:24:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:24:31 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:24:31 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:24:31 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:24:31 user nova-compute[72447]:   <serial>f5403d03-f9b9-4c5f-b5ee-ade0e5580e16</serial>
Jul 31 12:24:31 user nova-compute[72447]: </disk>
Jul 31 12:24:31 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:24:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:24:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:24:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] No VIF found with MAC fa:16:3e:76:18:63, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:24:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-999503c3-2374-4bc4-b0b7-3993731ac448 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.748s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:34 user nova-compute[72447]: INFO nova.compute.manager [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Terminating instance
Jul 31 12:24:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:34 user nova-compute[72447]: INFO nova.compute.manager [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Terminating instance
Jul 31 12:24:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Instance destroyed successfully.
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lazy-loading 'resources' on Instance uuid b291ba57-9fdb-48f2-ac0c-45a108dda3b1 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1458018657',display_name='tempest-VolumesAdminNegativeTest-server-1458018657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1458018657',id=22,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6gGsgHf+u6je3fi5pWRspe4+1YTnpK5hZvO8sUwujpYUpFmmvlxOMD5JFWNVDMpu2iD/kmIgb11TZGP3796bpNESzn0aILceRSguMB3asFulMT8qlvL2kj+wmGJcWUhQ==',key_name='tempest-keypair-2024619754',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:18:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3110024c6d94eff885a84c59a01a85c',ramdisk_id='',reservation_id='r-dg2dw1ts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-420445056',owner_user_name='tempest-VolumesAdminNegativeTest-420445056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ead2fe8321b41be8bfc78f2bd5a036b',uuid=b291ba57-9fdb-48f2-ac0c-45a108dda3b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "address": "fa:16:3e:59:1a:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd04ddb5-46", "ovs_interfaceid": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Converting VIF {"id": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "address": "fa:16:3e:59:1a:27", "network": {"id": "82f5659c-710d-46fe-afab-f2727a458ed4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1008055271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3110024c6d94eff885a84c59a01a85c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd04ddb5-46", "ovs_interfaceid": "cd04ddb5-4657-4e58-b422-7431d46e9ab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:1a:27,bridge_name='br-int',has_traffic_filtering=True,id=cd04ddb5-4657-4e58-b422-7431d46e9ab5,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd04ddb5-46') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG os_vif [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:1a:27,bridge_name='br-int',has_traffic_filtering=True,id=cd04ddb5-4657-4e58-b422-7431d46e9ab5,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd04ddb5-46') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd04ddb5-46, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:35 user nova-compute[72447]: INFO os_vif [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:1a:27,bridge_name='br-int',has_traffic_filtering=True,id=cd04ddb5-4657-4e58-b422-7431d46e9ab5,network=Network(82f5659c-710d-46fe-afab-f2727a458ed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd04ddb5-46')
Jul 31 12:24:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Deleting instance files /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1_del
Jul 31 12:24:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Deletion of /opt/stack/data/nova/instances/b291ba57-9fdb-48f2-ac0c-45a108dda3b1_del complete
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-00f2cc56-d74a-4e3b-a018-3b7e2beb5682 req-cd8bb9ea-cda8-4611-95f3-9b005afab91f service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Received event network-vif-unplugged-ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-00f2cc56-d74a-4e3b-a018-3b7e2beb5682 req-cd8bb9ea-cda8-4611-95f3-9b005afab91f service nova] Acquiring lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-00f2cc56-d74a-4e3b-a018-3b7e2beb5682 req-cd8bb9ea-cda8-4611-95f3-9b005afab91f service nova] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-00f2cc56-d74a-4e3b-a018-3b7e2beb5682 req-cd8bb9ea-cda8-4611-95f3-9b005afab91f service nova] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-00f2cc56-d74a-4e3b-a018-3b7e2beb5682 req-cd8bb9ea-cda8-4611-95f3-9b005afab91f service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] No waiting events found dispatching network-vif-unplugged-ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-00f2cc56-d74a-4e3b-a018-3b7e2beb5682 req-cd8bb9ea-cda8-4611-95f3-9b005afab91f service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Received event network-vif-unplugged-ab22b558-2e8f-481d-8c03-8d1294acd404 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:24:35 user nova-compute[72447]: INFO nova.compute.manager [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 31 12:24:35 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-bf511d80-6d90-4c3d-a118-24832ba5ebc4 req-aec3a04e-2d24-43b0-906d-91fa6d601d10 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Received event network-vif-unplugged-cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bf511d80-6d90-4c3d-a118-24832ba5ebc4 req-aec3a04e-2d24-43b0-906d-91fa6d601d10 service nova] Acquiring lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bf511d80-6d90-4c3d-a118-24832ba5ebc4 req-aec3a04e-2d24-43b0-906d-91fa6d601d10 service nova] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bf511d80-6d90-4c3d-a118-24832ba5ebc4 req-aec3a04e-2d24-43b0-906d-91fa6d601d10 service nova] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-bf511d80-6d90-4c3d-a118-24832ba5ebc4 req-aec3a04e-2d24-43b0-906d-91fa6d601d10 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] No waiting events found dispatching network-vif-unplugged-cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-bf511d80-6d90-4c3d-a118-24832ba5ebc4 req-aec3a04e-2d24-43b0-906d-91fa6d601d10 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Received event network-vif-unplugged-cd04ddb5-4657-4e58-b422-7431d46e9ab5 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:24:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Instance destroyed successfully.
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.objects.instance [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lazy-loading 'resources' on Instance uuid 8b487325-3b50-4f3f-857c-62fd0a64a6c0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-900187126',display_name='tempest-AttachVolumeNegativeTest-server-900187126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-900187126',id=28,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7vgDS+OSC+NByKp+mnYtgC5tV0dnsNl5qtVizb1f0VCROPbFBZAGjilQJhzp1H7IRmmruz9Okx5k2fF30H1BhQNWK5EC9Cx5V6ngthUPnXoC6XOQxHuSbFfOptbL33AQ==',key_name='tempest-keypair-756466582',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:21:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fad40b5f5e54e7ab9c6f8e78ceb3947',ramdisk_id='',reservation_id='r-bfqxpxz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-323727931',owner_user_name='tempest-AttachVolumeNegativeTest-323727931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:21:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a7feffde0f74f63a6bd027c1958aacb',uuid=8b487325-3b50-4f3f-857c-62fd0a64a6c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab22b558-2e8f-481d-8c03-8d1294acd404", "address": "fa:16:3e:34:09:9c", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab22b558-2e", "ovs_interfaceid": "ab22b558-2e8f-481d-8c03-8d1294acd404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converting VIF {"id": "ab22b558-2e8f-481d-8c03-8d1294acd404", "address": "fa:16:3e:34:09:9c", "network": {"id": "30bb7807-7321-42a2-bbd7-e31e9fdf5adf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1606000387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fad40b5f5e54e7ab9c6f8e78ceb3947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab22b558-2e", "ovs_interfaceid": "ab22b558-2e8f-481d-8c03-8d1294acd404", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:09:9c,bridge_name='br-int',has_traffic_filtering=True,id=ab22b558-2e8f-481d-8c03-8d1294acd404,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab22b558-2e') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG os_vif [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:09:9c,bridge_name='br-int',has_traffic_filtering=True,id=ab22b558-2e8f-481d-8c03-8d1294acd404,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab22b558-2e') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab22b558-2e, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:24:35 user nova-compute[72447]: INFO os_vif [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:09:9c,bridge_name='br-int',has_traffic_filtering=True,id=ab22b558-2e8f-481d-8c03-8d1294acd404,network=Network(30bb7807-7321-42a2-bbd7-e31e9fdf5adf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab22b558-2e')
Jul 31 12:24:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Deleting instance files /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0_del
Jul 31 12:24:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Deletion of /opt/stack/data/nova/instances/8b487325-3b50-4f3f-857c-62fd0a64a6c0_del complete
Jul 31 12:24:35 user nova-compute[72447]: INFO nova.compute.manager [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Took 1.00 seconds to destroy the instance on the hypervisor.
Jul 31 12:24:35 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:24:35 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:24:37 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Took 1.99 seconds to deallocate network for instance.
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Received event network-vif-plugged-ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] Acquiring lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] No waiting events found dispatching network-vif-plugged-ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:37 user nova-compute[72447]: WARNING nova.compute.manager [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Received unexpected event network-vif-plugged-ab22b558-2e8f-481d-8c03-8d1294acd404 for instance with vm_state active and task_state deleting.
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-changed-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Refreshing instance network info cache due to event network-changed-69b9e7de-13a8-4339-b2df-8547ea668cd7. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] Acquiring lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] Acquired lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.network.neutron [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Refreshing network info cache for port 69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-7416f806-6fb0-45c4-bc2d-dd0533ed44a2 req-482f1e28-42ba-4d21-88f5-2f741703f873 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Received event network-vif-plugged-cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7416f806-6fb0-45c4-bc2d-dd0533ed44a2 req-482f1e28-42ba-4d21-88f5-2f741703f873 service nova] Acquiring lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7416f806-6fb0-45c4-bc2d-dd0533ed44a2 req-482f1e28-42ba-4d21-88f5-2f741703f873 service nova] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7416f806-6fb0-45c4-bc2d-dd0533ed44a2 req-482f1e28-42ba-4d21-88f5-2f741703f873 service nova] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-7416f806-6fb0-45c4-bc2d-dd0533ed44a2 req-482f1e28-42ba-4d21-88f5-2f741703f873 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] No waiting events found dispatching network-vif-plugged-cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:37 user nova-compute[72447]: WARNING nova.compute.manager [req-7416f806-6fb0-45c4-bc2d-dd0533ed44a2 req-482f1e28-42ba-4d21-88f5-2f741703f873 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Received unexpected event network-vif-plugged-cd04ddb5-4657-4e58-b422-7431d46e9ab5 for instance with vm_state deleted and task_state None.
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.compute.manager [req-7416f806-6fb0-45c4-bc2d-dd0533ed44a2 req-482f1e28-42ba-4d21-88f5-2f741703f873 service nova] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Received event network-vif-deleted-cd04ddb5-4657-4e58-b422-7431d46e9ab5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:24:37 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Took 1.82 seconds to deallocate network for instance.
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.270s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:37 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Deleted allocations for instance b291ba57-9fdb-48f2-ac0c-45a108dda3b1
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb1ff47-3efd-4d1c-9263-c8c546bd3389 tempest-VolumesAdminNegativeTest-420445056 tempest-VolumesAdminNegativeTest-420445056-project-member] Lock "b291ba57-9fdb-48f2-ac0c-45a108dda3b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.651s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.network.neutron [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updated VIF entry in instance network info cache for port 69b9e7de-13a8-4339-b2df-8547ea668cd7. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG nova.network.neutron [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updating instance_info_cache with network_info: [{"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:24:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0fd7f577-822a-4d80-92a1-c8014bcf121b req-499e3ae6-b61c-409f-8192-650e8f88438c service nova] Releasing lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:24:38 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:24:38 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:24:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:38 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Deleted allocations for instance 8b487325-3b50-4f3f-857c-62fd0a64a6c0
Jul 31 12:24:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f0aa691f-c607-4353-9b2d-77eb8f3a895d tempest-AttachVolumeNegativeTest-323727931 tempest-AttachVolumeNegativeTest-323727931-project-member] Lock "8b487325-3b50-4f3f-857c-62fd0a64a6c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.742s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG nova.compute.manager [req-94210284-93b7-4aed-a402-ee10a41c31a0 req-19a629b3-b4e0-435a-96bd-429c1e1b3062 service nova] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Received event network-vif-deleted-ab22b558-2e8f-481d-8c03-8d1294acd404 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG nova.compute.manager [req-94210284-93b7-4aed-a402-ee10a41c31a0 req-19a629b3-b4e0-435a-96bd-429c1e1b3062 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-changed-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG nova.compute.manager [req-94210284-93b7-4aed-a402-ee10a41c31a0 req-19a629b3-b4e0-435a-96bd-429c1e1b3062 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Refreshing instance network info cache due to event network-changed-69b9e7de-13a8-4339-b2df-8547ea668cd7. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-94210284-93b7-4aed-a402-ee10a41c31a0 req-19a629b3-b4e0-435a-96bd-429c1e1b3062 service nova] Acquiring lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-94210284-93b7-4aed-a402-ee10a41c31a0 req-19a629b3-b4e0-435a-96bd-429c1e1b3062 service nova] Acquired lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG nova.network.neutron [req-94210284-93b7-4aed-a402-ee10a41c31a0 req-19a629b3-b4e0-435a-96bd-429c1e1b3062 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Refreshing network info cache for port 69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:39 user nova-compute[72447]: INFO nova.compute.manager [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Rebooting instance
Jul 31 12:24:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG nova.network.neutron [req-94210284-93b7-4aed-a402-ee10a41c31a0 req-19a629b3-b4e0-435a-96bd-429c1e1b3062 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updated VIF entry in instance network info cache for port 69b9e7de-13a8-4339-b2df-8547ea668cd7. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG nova.network.neutron [req-94210284-93b7-4aed-a402-ee10a41c31a0 req-19a629b3-b4e0-435a-96bd-429c1e1b3062 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updating instance_info_cache with network_info: [{"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-94210284-93b7-4aed-a402-ee10a41c31a0 req-19a629b3-b4e0-435a-96bd-429c1e1b3062 service nova] Releasing lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquired lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG nova.network.neutron [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:24:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:40 user nova-compute[72447]: DEBUG nova.network.neutron [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updating instance_info_cache with network_info: [{"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:24:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Releasing lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:24:40 user nova-compute[72447]: DEBUG nova.compute.manager [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:24:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-80f6b464-68d9-4f12-a280-e0d85e9552b3 req-e1140e10-f64c-4fb9-bac2-609ab5991a75 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-vif-unplugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80f6b464-68d9-4f12-a280-e0d85e9552b3 req-e1140e10-f64c-4fb9-bac2-609ab5991a75 service nova] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80f6b464-68d9-4f12-a280-e0d85e9552b3 req-e1140e10-f64c-4fb9-bac2-609ab5991a75 service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:42 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80f6b464-68d9-4f12-a280-e0d85e9552b3 req-e1140e10-f64c-4fb9-bac2-609ab5991a75 service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:42 user nova-compute[72447]: DEBUG nova.compute.manager [req-80f6b464-68d9-4f12-a280-e0d85e9552b3 req-e1140e10-f64c-4fb9-bac2-609ab5991a75 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] No waiting events found dispatching network-vif-unplugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:42 user nova-compute[72447]: WARNING nova.compute.manager [req-80f6b464-68d9-4f12-a280-e0d85e9552b3 req-e1140e10-f64c-4fb9-bac2-609ab5991a75 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received unexpected event network-vif-unplugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 for instance with vm_state active and task_state reboot_started.
Jul 31 12:24:43 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Instance shutdown successfully.
Jul 31 12:24:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-5c94f5f2-ceec-4fab-95d5-8476f8e8a488 req-2d3ddc6b-759c-448c-940a-05216b0d6567 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5c94f5f2-ceec-4fab-95d5-8476f8e8a488 req-2d3ddc6b-759c-448c-940a-05216b0d6567 service nova] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5c94f5f2-ceec-4fab-95d5-8476f8e8a488 req-2d3ddc6b-759c-448c-940a-05216b0d6567 service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5c94f5f2-ceec-4fab-95d5-8476f8e8a488 req-2d3ddc6b-759c-448c-940a-05216b0d6567 service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:44 user nova-compute[72447]: DEBUG nova.compute.manager [req-5c94f5f2-ceec-4fab-95d5-8476f8e8a488 req-2d3ddc6b-759c-448c-940a-05216b0d6567 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] No waiting events found dispatching network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:44 user nova-compute[72447]: WARNING nova.compute.manager [req-5c94f5f2-ceec-4fab-95d5-8476f8e8a488 req-2d3ddc6b-759c-448c-940a-05216b0d6567 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received unexpected event network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 for instance with vm_state active and task_state reboot_started.
Jul 31 12:24:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:24:46 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806286.8759506, 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:24:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] VM Resumed (Lifecycle Event)
Jul 31 12:24:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Instance running successfully.
Jul 31 12:24:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Instance soft rebooted successfully.
Jul 31 12:24:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:24:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:24:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:24:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 31 12:24:46 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806286.8772113, 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:24:46 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] VM Started (Lifecycle Event)
Jul 31 12:24:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:24:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-26a748f0-5c39-4a16-8247-96968d9fd864 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.401s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-822b77bd-ee8a-4c66-bb6c-083d630c8c4a req-9fbe89b4-a52e-4140-9e9a-b220cd2bf78e service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-822b77bd-ee8a-4c66-bb6c-083d630c8c4a req-9fbe89b4-a52e-4140-9e9a-b220cd2bf78e service nova] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-822b77bd-ee8a-4c66-bb6c-083d630c8c4a req-9fbe89b4-a52e-4140-9e9a-b220cd2bf78e service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-822b77bd-ee8a-4c66-bb6c-083d630c8c4a req-9fbe89b4-a52e-4140-9e9a-b220cd2bf78e service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-822b77bd-ee8a-4c66-bb6c-083d630c8c4a req-9fbe89b4-a52e-4140-9e9a-b220cd2bf78e service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] No waiting events found dispatching network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:47 user nova-compute[72447]: WARNING nova.compute.manager [req-822b77bd-ee8a-4c66-bb6c-083d630c8c4a req-9fbe89b4-a52e-4140-9e9a-b220cd2bf78e service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received unexpected event network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 for instance with vm_state active and task_state None.
Jul 31 12:24:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-822b77bd-ee8a-4c66-bb6c-083d630c8c4a req-9fbe89b4-a52e-4140-9e9a-b220cd2bf78e service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-822b77bd-ee8a-4c66-bb6c-083d630c8c4a req-9fbe89b4-a52e-4140-9e9a-b220cd2bf78e service nova] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-822b77bd-ee8a-4c66-bb6c-083d630c8c4a req-9fbe89b4-a52e-4140-9e9a-b220cd2bf78e service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-822b77bd-ee8a-4c66-bb6c-083d630c8c4a req-9fbe89b4-a52e-4140-9e9a-b220cd2bf78e service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-822b77bd-ee8a-4c66-bb6c-083d630c8c4a req-9fbe89b4-a52e-4140-9e9a-b220cd2bf78e service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] No waiting events found dispatching network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:47 user nova-compute[72447]: WARNING nova.compute.manager [req-822b77bd-ee8a-4c66-bb6c-083d630c8c4a req-9fbe89b4-a52e-4140-9e9a-b220cd2bf78e service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received unexpected event network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 for instance with vm_state active and task_state None.
Jul 31 12:24:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:47 user nova-compute[72447]: INFO nova.compute.manager [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Terminating instance
Jul 31 12:24:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Instance destroyed successfully.
Jul 31 12:24:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lazy-loading 'resources' on Instance uuid 92ff498b-1337-47da-aaf1-b5fb9f19e98d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-89958571',display_name='tempest-ServerActionsTestOtherB-server-89958571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-89958571',id=17,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+f+k0iUUuOhXlHDtikwFngFfrKZWO/pXd3lnR3i6FVV78yfGidAD1wnO5wJJhLxF9aq2IfkjSAFEQM+7NMJo1w081YcYQwauvTLFPqn5c5JoXRC/7+8j1JXyzJ3lUTfg==',key_name='tempest-keypair-1372814901',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:22:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cdf6c9123e14bf7aa1dc369852d1f06',ramdisk_id='',reservation_id='r-6pk3jb2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1175098759',owner_user_name='tempest-ServerActionsTestOtherB-1175098759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='179d710ed6d3412bbfd665d30ccc6451',uuid=92ff498b-1337-47da-aaf1-b5fb9f19e98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converting VIF {"id": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "address": "fa:16:3e:f8:df:6b", "network": {"id": "d8852e44-caa2-4a45-b218-37c653ef3c51", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-280907744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cdf6c9123e14bf7aa1dc369852d1f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bf862f6-24", "ovs_interfaceid": "8bf862f6-240f-47c4-bf1a-3cf399024ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_vif [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bf862f6-24, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:24:48 user nova-compute[72447]: INFO os_vif [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bf862f6-240f-47c4-bf1a-3cf399024ae2,network=Network(d8852e44-caa2-4a45-b218-37c653ef3c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bf862f6-24')
Jul 31 12:24:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSZgmNxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:24:48 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[699377d7-4d4a-4f95-9450-6f5d09f9c0de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa561e7-f603-4e00-980c-77ec972e129f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:24:48 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:24:48 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:24:48 user nova-compute[72447]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)
Jul 31 12:24:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:24:48 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:24:48 user nova-compute[72447]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc (non-flash)
Jul 31 12:24:48 user nova-compute[72447]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)
Jul 31 12:24:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0668677f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc'): ({'sdd'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Removing single pathed devices sdd {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[11028f36-7d3f-4030-9ce6-99731d66eaac]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7abe40-1d13-4ffa-a3ca-9d59c15d0e6b]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Flushing IO for device /dev/sdd {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3405839-5a84-4da8-b425-a87b7f75e774]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-bdfce9a5-270e-4583-99b7-75d5de6340f6 req-b1bce35c-503b-4a5b-96be-d4ad1dea2dc2 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-unplugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bdfce9a5-270e-4583-99b7-75d5de6340f6 req-b1bce35c-503b-4a5b-96be-d4ad1dea2dc2 service nova] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bdfce9a5-270e-4583-99b7-75d5de6340f6 req-b1bce35c-503b-4a5b-96be-d4ad1dea2dc2 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bdfce9a5-270e-4583-99b7-75d5de6340f6 req-b1bce35c-503b-4a5b-96be-d4ad1dea2dc2 service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-bdfce9a5-270e-4583-99b7-75d5de6340f6 req-b1bce35c-503b-4a5b-96be-d4ad1dea2dc2 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] No waiting events found dispatching network-vif-unplugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-bdfce9a5-270e-4583-99b7-75d5de6340f6 req-b1bce35c-503b-4a5b-96be-d4ad1dea2dc2 service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-unplugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbf41ee-a302-442b-bbbf-d70013b13d80]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc94fce-c6ee-471f-853a-8422591c6e1e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[068dffde-a618-4201-be14-209d693f5c67]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260]
Jul 31 12:24:48 user nova-compute[72447]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc, portal: 172.16.0.220,3260] successful.
Jul 31 12:24:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea50b8f7-7a26-4da4-b1a2-e2a0a1434adc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e130bb-c301-465e-bc43-797d6b3ea6d1]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] <== disconnect_volume: return (324ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:24:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Deleting instance files /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d_del
Jul 31 12:24:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Deletion of /opt/stack/data/nova/instances/92ff498b-1337-47da-aaf1-b5fb9f19e98d_del complete
Jul 31 12:24:48 user nova-compute[72447]: INFO nova.compute.manager [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Took 1.24 seconds to destroy the instance on the hypervisor.
Jul 31 12:24:48 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:24:48 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:24:49 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:24:49 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Took 0.92 seconds to deallocate network for instance.
Jul 31 12:24:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:50 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806275.04176, b291ba57-9fdb-48f2-ac0c-45a108dda3b1 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:24:50 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] VM Stopped (Lifecycle Event)
Jul 31 12:24:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-25a24201-7b1d-4c56-a56d-a82410a118d3 None None] [instance: b291ba57-9fdb-48f2-ac0c-45a108dda3b1] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:24:50 user nova-compute[72447]: INFO nova.compute.manager [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Took 0.86 seconds to detach 1 volumes for instance.
Jul 31 12:24:50 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806275.4309878, 8b487325-3b50-4f3f-857c-62fd0a64a6c0 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:24:50 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] VM Stopped (Lifecycle Event)
Jul 31 12:24:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-690d2f4a-4eb5-409f-a7fc-8bdf7f5db679 req-b2c0a9db-12f0-422c-8e10-d58f04c3079f service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-690d2f4a-4eb5-409f-a7fc-8bdf7f5db679 req-b2c0a9db-12f0-422c-8e10-d58f04c3079f service nova] Acquiring lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-690d2f4a-4eb5-409f-a7fc-8bdf7f5db679 req-b2c0a9db-12f0-422c-8e10-d58f04c3079f service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-690d2f4a-4eb5-409f-a7fc-8bdf7f5db679 req-b2c0a9db-12f0-422c-8e10-d58f04c3079f service nova] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-690d2f4a-4eb5-409f-a7fc-8bdf7f5db679 req-b2c0a9db-12f0-422c-8e10-d58f04c3079f service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] No waiting events found dispatching network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:24:50 user nova-compute[72447]: WARNING nova.compute.manager [req-690d2f4a-4eb5-409f-a7fc-8bdf7f5db679 req-b2c0a9db-12f0-422c-8e10-d58f04c3079f service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received unexpected event network-vif-plugged-8bf862f6-240f-47c4-bf1a-3cf399024ae2 for instance with vm_state active and task_state deleting.
Jul 31 12:24:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-690d2f4a-4eb5-409f-a7fc-8bdf7f5db679 req-b2c0a9db-12f0-422c-8e10-d58f04c3079f service nova] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Received event network-vif-deleted-8bf862f6-240f-47c4-bf1a-3cf399024ae2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-037fc3a7-ff14-4814-94c9-3f75f997951f None None] [instance: 8b487325-3b50-4f3f-857c-62fd0a64a6c0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:24:50 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:24:50 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:24:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:50 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Deleted allocations for instance 92ff498b-1337-47da-aaf1-b5fb9f19e98d
Jul 31 12:24:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9c1be292-ffc2-40b6-ac42-95ea2a94ee00 tempest-ServerActionsTestOtherB-1175098759 tempest-ServerActionsTestOtherB-1175098759-project-member] Lock "92ff498b-1337-47da-aaf1-b5fb9f19e98d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.590s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:52 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:24:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:53 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:24:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:24:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:24:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:24:53 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:24:53 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Updating instance_info_cache with network_info: [{"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:24:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-00c9825b-0cc3-4c07-87bf-bffaabe4c265" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:24:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:24:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:24:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:24:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:24:54 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:24:54 user nova-compute[72447]: INFO nova.compute.claims [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Claim successful on node user
Jul 31 12:24:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:24:55 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:24:55 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:24:55 user nova-compute[72447]: INFO nova.virt.block_device [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Booting with volume 96012daf-491b-4fec-be48-6beaf6b1d351 at /dev/vda
Jul 31 12:24:55 user nova-compute[72447]: DEBUG nova.policy [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bfd7290fb1a45b7a27cfb5faa08cc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afa936e9674cce91443f7bef7409ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG os_brick.utils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc19688-1b11-471f-9960-23aacafcb70e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d4419f-5e5d-478e-965a-fe821b9aee94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa0d0b3-6506-4032-83c7-ced27f60b6d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df8b512-5c2f-4967-9c2e-9a738f347859]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:24:55 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:24:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca42519-72b0-40bb-b00e-c0bfe4428cf3]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG os_brick.utils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:24:55 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updating existing volume attachment record: 9f261224-c1ed-4398-ae52-6ad32c70b572 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:24:56 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:24:56 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Successfully created port: b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:24:57 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:24:57 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:24:57 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:24:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:24:57 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Successfully updated port: b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:24:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:24:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquired lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:24:57 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:24:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-443cc9b3-d82e-4dd9-9afe-50ccb97691da req-51d80e02-6254-41fc-818a-0a2e23a10b09 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received event network-changed-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:24:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-443cc9b3-d82e-4dd9-9afe-50ccb97691da req-51d80e02-6254-41fc-818a-0a2e23a10b09 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Refreshing instance network info cache due to event network-changed-b1cb45da-a35d-45d4-90a1-031caf0f3c84. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:24:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-443cc9b3-d82e-4dd9-9afe-50ccb97691da req-51d80e02-6254-41fc-818a-0a2e23a10b09 service nova] Acquiring lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:24:57 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:24:58 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updating instance_info_cache with network_info: [{"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:24:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Releasing lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:24:58 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Instance network_info: |[{"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:24:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-443cc9b3-d82e-4dd9-9afe-50ccb97691da req-51d80e02-6254-41fc-818a-0a2e23a10b09 service nova] Acquired lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:24:58 user nova-compute[72447]: DEBUG nova.network.neutron [req-443cc9b3-d82e-4dd9-9afe-50ccb97691da req-51d80e02-6254-41fc-818a-0a2e23a10b09 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Refreshing network info cache for port b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:24:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:24:58 user nova-compute[72447]: DEBUG nova.network.neutron [req-443cc9b3-d82e-4dd9-9afe-50ccb97691da req-51d80e02-6254-41fc-818a-0a2e23a10b09 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updated VIF entry in instance network info cache for port b1cb45da-a35d-45d4-90a1-031caf0f3c84. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:24:58 user nova-compute[72447]: DEBUG nova.network.neutron [req-443cc9b3-d82e-4dd9-9afe-50ccb97691da req-51d80e02-6254-41fc-818a-0a2e23a10b09 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updating instance_info_cache with network_info: [{"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:24:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-443cc9b3-d82e-4dd9-9afe-50ccb97691da req-51d80e02-6254-41fc-818a-0a2e23a10b09 service nova] Releasing lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:24:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:00 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:25:01 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:25:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:01 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:25:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806288.1635084, 92ff498b-1337-47da-aaf1-b5fb9f19e98d => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:25:03 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] VM Stopped (Lifecycle Event)
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-19a45252-ddea-45a7-a796-6fe4841919d3 None None] [instance: 92ff498b-1337-47da-aaf1-b5fb9f19e98d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:25:04 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Creating image(s)
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Ensure instance console log exists: /opt/stack/data/nova/instances/2a481721-232b-4a4d-83ad-cfbac144bb5e/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Start _get_guest_xml network_info=[{"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '9f261224-c1ed-4398-ae52-6ad32c70b572', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQxtpKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2a481721-232b-4a4d-83ad-cfbac144bb5e', 'attached_at': '', 'detached_at': '', 'volume_id': '96012daf-491b-4fec-be48-6beaf6b1d351', 'serial': '96012daf-491b-4fec-be48-6beaf6b1d351'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:04 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:25:04 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQxtpKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:25:04 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:25:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:25:04 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:25:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:25:04 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe2f29f-81e0-4362-be6b-f3c0aa37ddb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:25:04 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:25:04 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:25:04 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:25:04 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7329MB free_disk=25.084125518798828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd86738-b8b5-44b5-b3fc-5c3a6cc68b00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351] added
Jul 31 12:25:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6aef2a-8282-4d1e-897f-2434a3293975]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[873be354-611f-4044-8ab5-7177dac5d564]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQxtpKyv {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQxtpKyv" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9692c04a-64a2-4aa2-b894-d006f7b25fdb]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wQxtpKyv'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:25:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd68815-3b83-455f-a820-23a7d2671063]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b5fe9835-8278-449e-9069-18421cb088dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 483f6f7a-c61d-46dd-893b-29b80da3f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 16a82016-d342-4a52-909f-45d363f9d8a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance f3f1534b-16c0-4dee-b78c-d53713113a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2a481721-232b-4a4d-83ad-cfbac144bb5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[976c1d9d-5fe6-49b8-889e-fbfcd51049bf]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e908652c-203b-4487-989d-afbd5ca9b65b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260]
Jul 31 12:25:05 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260] successful.
Jul 31 12:25:05 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c0d4e0-dbfd-4ecc-9d13-8a5a43acebdf]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d238fa-1986-47c7-9a3b-0d20b320c706]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:25:05 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.719s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa352723-5e54-4a59-b073-f9d44186cbef]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQxtpKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:25:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.757s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== connect_volume: return (1758ms) {'type': 'block', 'scsi_wwn': '23634663634663564', 'path': '/dev/sdd'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634663634663564', 'path': '/dev/sdd'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-13195892',display_name='tempest-ServerActionsTestOtherA-server-13195892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-13195892',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWDGihKbMeCNvBwsaW6V6P8R5lowbGENHMAc92pWv6O2vQFLobOnEOvb/OjxIDRXej4CqXst6J0oTtwIiGi8MF4pETlYJBg2aTwKoMBAuzDXV9HfutMu8dkCAol0vT0Q==',key_name='tempest-keypair-1212175094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25afa936e9674cce91443f7bef7409ab',ramdisk_id='',reservation_id='r-lnqp7hno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1904418117',owner_user_name='tempest-ServerActionsTestOtherA-1904418117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfd7290fb1a45b7a27cfb5faa08cc5d',uuid=2a481721-232b-4a4d-83ad-cfbac144bb5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converting VIF {"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG nova.objects.instance [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a481721-232b-4a4d-83ad-cfbac144bb5e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:25:06 user nova-compute[72447]:   <uuid>2a481721-232b-4a4d-83ad-cfbac144bb5e</uuid>
Jul 31 12:25:06 user nova-compute[72447]:   <name>instance-00000020</name>
Jul 31 12:25:06 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:25:06 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:25:06 user nova-compute[72447]:   <metadata>
Jul 31 12:25:06 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:25:06 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:25:06 user nova-compute[72447]:       <nova:name>tempest-ServerActionsTestOtherA-server-13195892</nova:name>
Jul 31 12:25:06 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:25:04</nova:creationTime>
Jul 31 12:25:06 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:25:06 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:25:06 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:25:06 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:25:06 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:25:06 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:25:06 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:25:06 user nova-compute[72447]:       <nova:owner>
Jul 31 12:25:06 user nova-compute[72447]:         <nova:user uuid="0bfd7290fb1a45b7a27cfb5faa08cc5d">tempest-ServerActionsTestOtherA-1904418117-project-member</nova:user>
Jul 31 12:25:06 user nova-compute[72447]:         <nova:project uuid="25afa936e9674cce91443f7bef7409ab">tempest-ServerActionsTestOtherA-1904418117</nova:project>
Jul 31 12:25:06 user nova-compute[72447]:       </nova:owner>
Jul 31 12:25:06 user nova-compute[72447]:       <nova:ports>
Jul 31 12:25:06 user nova-compute[72447]:         <nova:port uuid="b1cb45da-a35d-45d4-90a1-031caf0f3c84">
Jul 31 12:25:06 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 12:25:06 user nova-compute[72447]:         </nova:port>
Jul 31 12:25:06 user nova-compute[72447]:       </nova:ports>
Jul 31 12:25:06 user nova-compute[72447]:     </nova:instance>
Jul 31 12:25:06 user nova-compute[72447]:   </metadata>
Jul 31 12:25:06 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:25:06 user nova-compute[72447]:     <system>
Jul 31 12:25:06 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:25:06 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:25:06 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:25:06 user nova-compute[72447]:       <entry name="serial">2a481721-232b-4a4d-83ad-cfbac144bb5e</entry>
Jul 31 12:25:06 user nova-compute[72447]:       <entry name="uuid">2a481721-232b-4a4d-83ad-cfbac144bb5e</entry>
Jul 31 12:25:06 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:25:06 user nova-compute[72447]:     </system>
Jul 31 12:25:06 user nova-compute[72447]:   </sysinfo>
Jul 31 12:25:06 user nova-compute[72447]:   <os>
Jul 31 12:25:06 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:25:06 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:25:06 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:25:06 user nova-compute[72447]:   </os>
Jul 31 12:25:06 user nova-compute[72447]:   <features>
Jul 31 12:25:06 user nova-compute[72447]:     <acpi/>
Jul 31 12:25:06 user nova-compute[72447]:     <apic/>
Jul 31 12:25:06 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:25:06 user nova-compute[72447]:   </features>
Jul 31 12:25:06 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:25:06 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:25:06 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:25:06 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:25:06 user nova-compute[72447]:   </clock>
Jul 31 12:25:06 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:25:06 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:25:06 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:25:06 user nova-compute[72447]:   </cpu>
Jul 31 12:25:06 user nova-compute[72447]:   <devices>
Jul 31 12:25:06 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:25:06 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:25:06 user nova-compute[72447]:       <source dev="/dev/sdd"/>
Jul 31 12:25:06 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:25:06 user nova-compute[72447]:       <serial>96012daf-491b-4fec-be48-6beaf6b1d351</serial>
Jul 31 12:25:06 user nova-compute[72447]:     </disk>
Jul 31 12:25:06 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:25:06 user nova-compute[72447]:       <mac address="fa:16:3e:cd:ae:8c"/>
Jul 31 12:25:06 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:25:06 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:25:06 user nova-compute[72447]:       <target dev="tapb1cb45da-a3"/>
Jul 31 12:25:06 user nova-compute[72447]:     </interface>
Jul 31 12:25:06 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:25:06 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/2a481721-232b-4a4d-83ad-cfbac144bb5e/console.log" append="off"/>
Jul 31 12:25:06 user nova-compute[72447]:     </serial>
Jul 31 12:25:06 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:25:06 user nova-compute[72447]:     <video>
Jul 31 12:25:06 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:25:06 user nova-compute[72447]:     </video>
Jul 31 12:25:06 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:25:06 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:25:06 user nova-compute[72447]:     </rng>
Jul 31 12:25:06 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:25:06 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:25:06 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:25:06 user nova-compute[72447]:     </memballoon>
Jul 31 12:25:06 user nova-compute[72447]:   </devices>
Jul 31 12:25:06 user nova-compute[72447]: </domain>
Jul 31 12:25:06 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-13195892',display_name='tempest-ServerActionsTestOtherA-server-13195892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-13195892',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWDGihKbMeCNvBwsaW6V6P8R5lowbGENHMAc92pWv6O2vQFLobOnEOvb/OjxIDRXej4CqXst6J0oTtwIiGi8MF4pETlYJBg2aTwKoMBAuzDXV9HfutMu8dkCAol0vT0Q==',key_name='tempest-keypair-1212175094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25afa936e9674cce91443f7bef7409ab',ramdisk_id='',reservation_id='r-lnqp7hno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1904418117',owner_user_name='tempest-ServerActionsTestOtherA-1904418117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfd7290fb1a45b7a27cfb5faa08cc5d',uuid=2a481721-232b-4a4d-83ad-cfbac144bb5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converting VIF {"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG os_vif [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1cb45da-a3, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1cb45da-a3, col_values=(('external_ids', {'iface-id': 'b1cb45da-a35d-45d4-90a1-031caf0f3c84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:ae:8c', 'vm-uuid': '2a481721-232b-4a4d-83ad-cfbac144bb5e'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:06 user nova-compute[72447]: INFO os_vif [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3')
Jul 31 12:25:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:25:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] No VIF found with MAC fa:16:3e:cd:ae:8c, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:25:07 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:25:07 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:25:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-730a69ca-1f72-4426-a4d9-8f0b3d8e83db req-2cd60cee-61f5-49c2-aaa3-06746bb74789 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received event network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:25:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-730a69ca-1f72-4426-a4d9-8f0b3d8e83db req-2cd60cee-61f5-49c2-aaa3-06746bb74789 service nova] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-730a69ca-1f72-4426-a4d9-8f0b3d8e83db req-2cd60cee-61f5-49c2-aaa3-06746bb74789 service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-730a69ca-1f72-4426-a4d9-8f0b3d8e83db req-2cd60cee-61f5-49c2-aaa3-06746bb74789 service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-730a69ca-1f72-4426-a4d9-8f0b3d8e83db req-2cd60cee-61f5-49c2-aaa3-06746bb74789 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] No waiting events found dispatching network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:25:07 user nova-compute[72447]: WARNING nova.compute.manager [req-730a69ca-1f72-4426-a4d9-8f0b3d8e83db req-2cd60cee-61f5-49c2-aaa3-06746bb74789 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received unexpected event network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 for instance with vm_state building and task_state spawning.
Jul 31 12:25:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806309.8794482, 2a481721-232b-4a4d-83ad-cfbac144bb5e => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:25:09 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] VM Resumed (Lifecycle Event)
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:25:09 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Instance spawned successfully.
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:25:09 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806309.8804865, 2a481721-232b-4a4d-83ad-cfbac144bb5e => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:25:09 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] VM Started (Lifecycle Event)
Jul 31 12:25:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:25:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:25:09 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:25:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-f6cfdb35-c8c7-4cab-966b-26a9761c9e02 req-27a6b0fb-7298-48ce-a36f-b24bcb1bc370 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received event network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:25:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f6cfdb35-c8c7-4cab-966b-26a9761c9e02 req-27a6b0fb-7298-48ce-a36f-b24bcb1bc370 service nova] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f6cfdb35-c8c7-4cab-966b-26a9761c9e02 req-27a6b0fb-7298-48ce-a36f-b24bcb1bc370 service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f6cfdb35-c8c7-4cab-966b-26a9761c9e02 req-27a6b0fb-7298-48ce-a36f-b24bcb1bc370 service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-f6cfdb35-c8c7-4cab-966b-26a9761c9e02 req-27a6b0fb-7298-48ce-a36f-b24bcb1bc370 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] No waiting events found dispatching network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:25:10 user nova-compute[72447]: WARNING nova.compute.manager [req-f6cfdb35-c8c7-4cab-966b-26a9761c9e02 req-27a6b0fb-7298-48ce-a36f-b24bcb1bc370 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received unexpected event network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 for instance with vm_state building and task_state spawning.
Jul 31 12:25:10 user nova-compute[72447]: INFO nova.compute.manager [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Took 5.65 seconds to spawn the instance on the hypervisor.
Jul 31 12:25:10 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:25:10 user nova-compute[72447]: INFO nova.compute.manager [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Took 15.22 seconds to build instance.
Jul 31 12:25:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1bd4c80a-b1a5-4d6b-907b-defbbf38be5e tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.314s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-cb08dc37-33c8-4ad8-862a-9b0603d11f03 req-0fc92c1c-744a-40f7-9cb7-7c2c93ad84c0 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-changed-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:25:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-cb08dc37-33c8-4ad8-862a-9b0603d11f03 req-0fc92c1c-744a-40f7-9cb7-7c2c93ad84c0 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Refreshing instance network info cache due to event network-changed-8cdc2eae-9d44-4619-ad18-98196a439f15. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:25:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cb08dc37-33c8-4ad8-862a-9b0603d11f03 req-0fc92c1c-744a-40f7-9cb7-7c2c93ad84c0 service nova] Acquiring lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:25:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cb08dc37-33c8-4ad8-862a-9b0603d11f03 req-0fc92c1c-744a-40f7-9cb7-7c2c93ad84c0 service nova] Acquired lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:25:14 user nova-compute[72447]: DEBUG nova.network.neutron [req-cb08dc37-33c8-4ad8-862a-9b0603d11f03 req-0fc92c1c-744a-40f7-9cb7-7c2c93ad84c0 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Refreshing network info cache for port 8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:25:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:15 user nova-compute[72447]: DEBUG nova.network.neutron [req-cb08dc37-33c8-4ad8-862a-9b0603d11f03 req-0fc92c1c-744a-40f7-9cb7-7c2c93ad84c0 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updated VIF entry in instance network info cache for port 8cdc2eae-9d44-4619-ad18-98196a439f15. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:25:15 user nova-compute[72447]: DEBUG nova.network.neutron [req-cb08dc37-33c8-4ad8-862a-9b0603d11f03 req-0fc92c1c-744a-40f7-9cb7-7c2c93ad84c0 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updating instance_info_cache with network_info: [{"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:25:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cb08dc37-33c8-4ad8-862a-9b0603d11f03 req-0fc92c1c-744a-40f7-9cb7-7c2c93ad84c0 service nova] Releasing lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:25:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:15 user nova-compute[72447]: INFO nova.compute.manager [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Detaching volume 442a0967-7ca5-4e03-a09e-9ce67c2698b9
Jul 31 12:25:15 user nova-compute[72447]: INFO nova.virt.block_device [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Attempting to driver detach volume 442a0967-7ca5-4e03-a09e-9ce67c2698b9 from mountpoint /dev/vdb
Jul 31 12:25:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Attempting to detach device vdb from instance 483f6f7a-c61d-46dd-893b-29b80da3f54d from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:25:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:25:15 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:25:15 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:25:15 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:25:15 user nova-compute[72447]:   <serial>442a0967-7ca5-4e03-a09e-9ce67c2698b9</serial>
Jul 31 12:25:15 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:25:15 user nova-compute[72447]: </disk>
Jul 31 12:25:15 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:25:15 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Successfully detached device vdb from instance 483f6f7a-c61d-46dd-893b-29b80da3f54d from the persistent domain config.
Jul 31 12:25:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 483f6f7a-c61d-46dd-893b-29b80da3f54d from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:25:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:25:15 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:25:15 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:25:15 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:25:15 user nova-compute[72447]:   <serial>442a0967-7ca5-4e03-a09e-9ce67c2698b9</serial>
Jul 31 12:25:15 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:25:15 user nova-compute[72447]: </disk>
Jul 31 12:25:15 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806316.189661, 483f6f7a-c61d-46dd-893b-29b80da3f54d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:25:16 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Successfully detached device vdb from instance 483f6f7a-c61d-46dd-893b-29b80da3f54d from the live domain config.
Jul 31 12:25:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnIeAJwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:25:16 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77023b9-5bf1-4fe3-852a-62acea33fcf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[43315ee5-bdc7-4268-8881-02cef5950e61]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:25:16 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:25:16 user nova-compute[72447]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)
Jul 31 12:25:16 user nova-compute[72447]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:25:16 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:25:16 user nova-compute[72447]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 (non-flash)
Jul 31 12:25:16 user nova-compute[72447]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)
Jul 31 12:25:16 user nova-compute[72447]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:25:16 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0670136b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec310fa-2738-4bee-940f-d6e76745bd8b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8107a5f-9480-48c3-82d3-8fd4bba68ae3]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[02906ab8-ce04-476c-a679-65a4132a1276]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0c12d6-d2ce-41e9-9cbb-a688e73f3f9f]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b755599-3f6b-4353-9769-3b38a997cd05]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1545763e-a6be-4443-8d5b-3107b7658e0f]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9, portal: 172.16.0.220,3260]
Jul 31 12:25:16 user nova-compute[72447]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9, portal: 172.16.0.220,3260] successful.
Jul 31 12:25:16 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:442a0967-7ca5-4e03-a09e-9ce67c2698b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aaf01e-6530-4d2d-b69f-e02d2f4dca3d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] <== disconnect_volume: return (328ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG nova.compute.manager [req-82748331-8f50-4e8c-bcde-540db9c55d7c req-826cbd48-c16d-44fc-b08e-3b9cf04cad7f service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-changed-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG nova.compute.manager [req-82748331-8f50-4e8c-bcde-540db9c55d7c req-826cbd48-c16d-44fc-b08e-3b9cf04cad7f service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Refreshing instance network info cache due to event network-changed-8cdc2eae-9d44-4619-ad18-98196a439f15. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-82748331-8f50-4e8c-bcde-540db9c55d7c req-826cbd48-c16d-44fc-b08e-3b9cf04cad7f service nova] Acquiring lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-82748331-8f50-4e8c-bcde-540db9c55d7c req-826cbd48-c16d-44fc-b08e-3b9cf04cad7f service nova] Acquired lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG nova.network.neutron [req-82748331-8f50-4e8c-bcde-540db9c55d7c req-826cbd48-c16d-44fc-b08e-3b9cf04cad7f service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Refreshing network info cache for port 8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:25:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:17 user nova-compute[72447]: DEBUG nova.network.neutron [req-82748331-8f50-4e8c-bcde-540db9c55d7c req-826cbd48-c16d-44fc-b08e-3b9cf04cad7f service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updated VIF entry in instance network info cache for port 8cdc2eae-9d44-4619-ad18-98196a439f15. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:25:17 user nova-compute[72447]: DEBUG nova.network.neutron [req-82748331-8f50-4e8c-bcde-540db9c55d7c req-826cbd48-c16d-44fc-b08e-3b9cf04cad7f service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updating instance_info_cache with network_info: [{"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:25:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-82748331-8f50-4e8c-bcde-540db9c55d7c req-826cbd48-c16d-44fc-b08e-3b9cf04cad7f service nova] Releasing lock "refresh_cache-483f6f7a-c61d-46dd-893b-29b80da3f54d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:25:17 user nova-compute[72447]: DEBUG nova.objects.instance [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'flavor' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:25:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1faba7f7-ab42-435e-b203-be7a692c09dc tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.860s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "16a82016-d342-4a52-909f-45d363f9d8a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "16a82016-d342-4a52-909f-45d363f9d8a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:29 user nova-compute[72447]: INFO nova.compute.manager [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Terminating instance
Jul 31 12:25:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-31dd2a24-4614-4fde-8285-8b3a23d28833 req-c6c5299a-3342-4f4c-b485-580dae01eb82 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Received event network-vif-unplugged-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31dd2a24-4614-4fde-8285-8b3a23d28833 req-c6c5299a-3342-4f4c-b485-580dae01eb82 service nova] Acquiring lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31dd2a24-4614-4fde-8285-8b3a23d28833 req-c6c5299a-3342-4f4c-b485-580dae01eb82 service nova] Lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-31dd2a24-4614-4fde-8285-8b3a23d28833 req-c6c5299a-3342-4f4c-b485-580dae01eb82 service nova] Lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-31dd2a24-4614-4fde-8285-8b3a23d28833 req-c6c5299a-3342-4f4c-b485-580dae01eb82 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] No waiting events found dispatching network-vif-unplugged-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-31dd2a24-4614-4fde-8285-8b3a23d28833 req-c6c5299a-3342-4f4c-b485-580dae01eb82 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Received event network-vif-unplugged-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Instance destroyed successfully.
Jul 31 12:25:29 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lazy-loading 'resources' on Instance uuid 16a82016-d342-4a52-909f-45d363f9d8a8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1411583077',display_name='tempest-VolumesActionsTest-instance-1411583077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1411583077',id=30,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:23:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49e21ac0a7354b85bcbe334edfc00fd5',ramdisk_id='',reservation_id='r-zgjej41c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-489730423',owner_user_name='tempest-VolumesActionsTest-489730423-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:23:45Z,user_data=None,user_id='1c7a178f684246608fded95196469c0f',uuid=16a82016-d342-4a52-909f-45d363f9d8a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "address": "fa:16:3e:43:67:6f", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa9aabc-b8", "ovs_interfaceid": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Converting VIF {"id": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "address": "fa:16:3e:43:67:6f", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa9aabc-b8", "ovs_interfaceid": "ffa9aabc-b8eb-4631-9ce1-0167b312ea32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:67:6f,bridge_name='br-int',has_traffic_filtering=True,id=ffa9aabc-b8eb-4631-9ce1-0167b312ea32,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa9aabc-b8') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG os_vif [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:67:6f,bridge_name='br-int',has_traffic_filtering=True,id=ffa9aabc-b8eb-4631-9ce1-0167b312ea32,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa9aabc-b8') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffa9aabc-b8, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:25:29 user nova-compute[72447]: INFO os_vif [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:67:6f,bridge_name='br-int',has_traffic_filtering=True,id=ffa9aabc-b8eb-4631-9ce1-0167b312ea32,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa9aabc-b8')
Jul 31 12:25:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Deleting instance files /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8_del
Jul 31 12:25:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Deletion of /opt/stack/data/nova/instances/16a82016-d342-4a52-909f-45d363f9d8a8_del complete
Jul 31 12:25:29 user nova-compute[72447]: INFO nova.compute.manager [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 31 12:25:29 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:25:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:30 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:25:30 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Took 0.55 seconds to deallocate network for instance.
Jul 31 12:25:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:30 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:25:30 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:25:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:31 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Deleted allocations for instance 16a82016-d342-4a52-909f-45d363f9d8a8
Jul 31 12:25:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3dfdc60f-5361-459e-ad9b-d2cf33d341eb tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "16a82016-d342-4a52-909f-45d363f9d8a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.107s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-376bcbe1-7c59-4c6f-999b-10148e3c0b04 req-51da2afe-9b90-4e23-ac0a-431de619a2a1 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Received event network-vif-plugged-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:25:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-376bcbe1-7c59-4c6f-999b-10148e3c0b04 req-51da2afe-9b90-4e23-ac0a-431de619a2a1 service nova] Acquiring lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-376bcbe1-7c59-4c6f-999b-10148e3c0b04 req-51da2afe-9b90-4e23-ac0a-431de619a2a1 service nova] Lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-376bcbe1-7c59-4c6f-999b-10148e3c0b04 req-51da2afe-9b90-4e23-ac0a-431de619a2a1 service nova] Lock "16a82016-d342-4a52-909f-45d363f9d8a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-376bcbe1-7c59-4c6f-999b-10148e3c0b04 req-51da2afe-9b90-4e23-ac0a-431de619a2a1 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] No waiting events found dispatching network-vif-plugged-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:25:31 user nova-compute[72447]: WARNING nova.compute.manager [req-376bcbe1-7c59-4c6f-999b-10148e3c0b04 req-51da2afe-9b90-4e23-ac0a-431de619a2a1 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Received unexpected event network-vif-plugged-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 for instance with vm_state deleted and task_state None.
Jul 31 12:25:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-376bcbe1-7c59-4c6f-999b-10148e3c0b04 req-51da2afe-9b90-4e23-ac0a-431de619a2a1 service nova] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Received event network-vif-deleted-ffa9aabc-b8eb-4631-9ce1-0167b312ea32 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:25:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "b71826ea-5fc4-4405-80b2-12e681ebb88a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:43 user nova-compute[72447]: DEBUG nova.compute.manager [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:25:44 user nova-compute[72447]: INFO nova.compute.claims [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Claim successful on node user
Jul 31 12:25:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG nova.network.neutron [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:25:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:25:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806329.791215, 16a82016-d342-4a52-909f-45d363f9d8a8 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:25:44 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] VM Stopped (Lifecycle Event)
Jul 31 12:25:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-41418a7b-775e-471a-a43d-86b4044eb7c4 None None] [instance: 16a82016-d342-4a52-909f-45d363f9d8a8] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:25:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Creating image(s)
Jul 31 12:25:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "/opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "/opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "/opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG nova.policy [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f1a34a7ac5a4a53a1051bfa2e61a713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09317a99770b41abaa8ba73252e034e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:25:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.154s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk 1073741824" returned: 0 in 0.062s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.160s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Cannot resize image /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG nova.objects.instance [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lazy-loading 'migration_context' on Instance uuid b71826ea-5fc4-4405-80b2-12e681ebb88a {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Ensure instance console log exists: /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Successfully created port: 4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:25:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Successfully updated port: 4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:25:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "refresh_cache-b71826ea-5fc4-4405-80b2-12e681ebb88a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:25:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquired lock "refresh_cache-b71826ea-5fc4-4405-80b2-12e681ebb88a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:25:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-1cdbb617-c948-45f3-9f8f-c668f4007fcd req-9f996521-4f67-4796-ac6c-cb71f6008104 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Received event network-changed-4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-1cdbb617-c948-45f3-9f8f-c668f4007fcd req-9f996521-4f67-4796-ac6c-cb71f6008104 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Refreshing instance network info cache due to event network-changed-4ada2961-0a0e-4d37-b977-c4838cb960fe. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1cdbb617-c948-45f3-9f8f-c668f4007fcd req-9f996521-4f67-4796-ac6c-cb71f6008104 service nova] Acquiring lock "refresh_cache-b71826ea-5fc4-4405-80b2-12e681ebb88a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.network.neutron [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.network.neutron [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Updating instance_info_cache with network_info: [{"id": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "address": "fa:16:3e:e7:7a:5c", "network": {"id": "d955ee3f-be94-4165-92f0-5fd5893f50aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-955978129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09317a99770b41abaa8ba73252e034e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ada2961-0a", "ovs_interfaceid": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Releasing lock "refresh_cache-b71826ea-5fc4-4405-80b2-12e681ebb88a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Instance network_info: |[{"id": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "address": "fa:16:3e:e7:7a:5c", "network": {"id": "d955ee3f-be94-4165-92f0-5fd5893f50aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-955978129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09317a99770b41abaa8ba73252e034e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ada2961-0a", "ovs_interfaceid": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1cdbb617-c948-45f3-9f8f-c668f4007fcd req-9f996521-4f67-4796-ac6c-cb71f6008104 service nova] Acquired lock "refresh_cache-b71826ea-5fc4-4405-80b2-12e681ebb88a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.network.neutron [req-1cdbb617-c948-45f3-9f8f-c668f4007fcd req-9f996521-4f67-4796-ac6c-cb71f6008104 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Refreshing network info cache for port 4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Start _get_guest_xml network_info=[{"id": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "address": "fa:16:3e:e7:7a:5c", "network": {"id": "d955ee3f-be94-4165-92f0-5fd5893f50aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-955978129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09317a99770b41abaa8ba73252e034e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ada2961-0a", "ovs_interfaceid": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:47 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:25:47 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2123936526',display_name='tempest-DeleteServersTestJSON-server-2123936526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2123936526',id=33,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09317a99770b41abaa8ba73252e034e2',ramdisk_id='',reservation_id='r-x7k4s0i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1035655362',owner_user_name='tempest-DeleteServersTestJSON-1035655362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:25:45Z,user_data=None,user_id='1f1a34a7ac5a4a53a1051bfa2e61a713',uuid=b71826ea-5fc4-4405-80b2-12e681ebb88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "address": "fa:16:3e:e7:7a:5c", "network": {"id": "d955ee3f-be94-4165-92f0-5fd5893f50aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-955978129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09317a99770b41abaa8ba73252e034e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ada2961-0a", "ovs_interfaceid": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Converting VIF {"id": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "address": "fa:16:3e:e7:7a:5c", "network": {"id": "d955ee3f-be94-4165-92f0-5fd5893f50aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-955978129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09317a99770b41abaa8ba73252e034e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ada2961-0a", "ovs_interfaceid": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7a:5c,bridge_name='br-int',has_traffic_filtering=True,id=4ada2961-0a0e-4d37-b977-c4838cb960fe,network=Network(d955ee3f-be94-4165-92f0-5fd5893f50aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ada2961-0a') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.objects.instance [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lazy-loading 'pci_devices' on Instance uuid b71826ea-5fc4-4405-80b2-12e681ebb88a {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:25:47 user nova-compute[72447]:   <uuid>b71826ea-5fc4-4405-80b2-12e681ebb88a</uuid>
Jul 31 12:25:47 user nova-compute[72447]:   <name>instance-00000021</name>
Jul 31 12:25:47 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:25:47 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:25:47 user nova-compute[72447]:   <metadata>
Jul 31 12:25:47 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:25:47 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:25:47 user nova-compute[72447]:       <nova:name>tempest-DeleteServersTestJSON-server-2123936526</nova:name>
Jul 31 12:25:47 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:25:47</nova:creationTime>
Jul 31 12:25:47 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:25:47 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:25:47 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:25:47 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:25:47 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:25:47 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:25:47 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:25:47 user nova-compute[72447]:       <nova:owner>
Jul 31 12:25:47 user nova-compute[72447]:         <nova:user uuid="1f1a34a7ac5a4a53a1051bfa2e61a713">tempest-DeleteServersTestJSON-1035655362-project-member</nova:user>
Jul 31 12:25:47 user nova-compute[72447]:         <nova:project uuid="09317a99770b41abaa8ba73252e034e2">tempest-DeleteServersTestJSON-1035655362</nova:project>
Jul 31 12:25:47 user nova-compute[72447]:       </nova:owner>
Jul 31 12:25:47 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:25:47 user nova-compute[72447]:       <nova:ports>
Jul 31 12:25:47 user nova-compute[72447]:         <nova:port uuid="4ada2961-0a0e-4d37-b977-c4838cb960fe">
Jul 31 12:25:47 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 12:25:47 user nova-compute[72447]:         </nova:port>
Jul 31 12:25:47 user nova-compute[72447]:       </nova:ports>
Jul 31 12:25:47 user nova-compute[72447]:     </nova:instance>
Jul 31 12:25:47 user nova-compute[72447]:   </metadata>
Jul 31 12:25:47 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:25:47 user nova-compute[72447]:     <system>
Jul 31 12:25:47 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:25:47 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:25:47 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:25:47 user nova-compute[72447]:       <entry name="serial">b71826ea-5fc4-4405-80b2-12e681ebb88a</entry>
Jul 31 12:25:47 user nova-compute[72447]:       <entry name="uuid">b71826ea-5fc4-4405-80b2-12e681ebb88a</entry>
Jul 31 12:25:47 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:25:47 user nova-compute[72447]:     </system>
Jul 31 12:25:47 user nova-compute[72447]:   </sysinfo>
Jul 31 12:25:47 user nova-compute[72447]:   <os>
Jul 31 12:25:47 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:25:47 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:25:47 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:25:47 user nova-compute[72447]:   </os>
Jul 31 12:25:47 user nova-compute[72447]:   <features>
Jul 31 12:25:47 user nova-compute[72447]:     <acpi/>
Jul 31 12:25:47 user nova-compute[72447]:     <apic/>
Jul 31 12:25:47 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:25:47 user nova-compute[72447]:   </features>
Jul 31 12:25:47 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:25:47 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:25:47 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:25:47 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:25:47 user nova-compute[72447]:   </clock>
Jul 31 12:25:47 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:25:47 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:25:47 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:25:47 user nova-compute[72447]:   </cpu>
Jul 31 12:25:47 user nova-compute[72447]:   <devices>
Jul 31 12:25:47 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:25:47 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:25:47 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk"/>
Jul 31 12:25:47 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:25:47 user nova-compute[72447]:     </disk>
Jul 31 12:25:47 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:25:47 user nova-compute[72447]:       <mac address="fa:16:3e:e7:7a:5c"/>
Jul 31 12:25:47 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:25:47 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:25:47 user nova-compute[72447]:       <target dev="tap4ada2961-0a"/>
Jul 31 12:25:47 user nova-compute[72447]:     </interface>
Jul 31 12:25:47 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:25:47 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/console.log" append="off"/>
Jul 31 12:25:47 user nova-compute[72447]:     </serial>
Jul 31 12:25:47 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:25:47 user nova-compute[72447]:     <video>
Jul 31 12:25:47 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:25:47 user nova-compute[72447]:     </video>
Jul 31 12:25:47 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:25:47 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:25:47 user nova-compute[72447]:     </rng>
Jul 31 12:25:47 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:25:47 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:25:47 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:25:47 user nova-compute[72447]:     </memballoon>
Jul 31 12:25:47 user nova-compute[72447]:   </devices>
Jul 31 12:25:47 user nova-compute[72447]: </domain>
Jul 31 12:25:47 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2123936526',display_name='tempest-DeleteServersTestJSON-server-2123936526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2123936526',id=33,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09317a99770b41abaa8ba73252e034e2',ramdisk_id='',reservation_id='r-x7k4s0i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1035655362',owner_user_name='tempest-DeleteServersTestJSON-1035655362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:25:45Z,user_data=None,user_id='1f1a34a7ac5a4a53a1051bfa2e61a713',uuid=b71826ea-5fc4-4405-80b2-12e681ebb88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "address": "fa:16:3e:e7:7a:5c", "network": {"id": "d955ee3f-be94-4165-92f0-5fd5893f50aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-955978129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09317a99770b41abaa8ba73252e034e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ada2961-0a", "ovs_interfaceid": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Converting VIF {"id": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "address": "fa:16:3e:e7:7a:5c", "network": {"id": "d955ee3f-be94-4165-92f0-5fd5893f50aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-955978129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09317a99770b41abaa8ba73252e034e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ada2961-0a", "ovs_interfaceid": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7a:5c,bridge_name='br-int',has_traffic_filtering=True,id=4ada2961-0a0e-4d37-b977-c4838cb960fe,network=Network(d955ee3f-be94-4165-92f0-5fd5893f50aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ada2961-0a') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG os_vif [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7a:5c,bridge_name='br-int',has_traffic_filtering=True,id=4ada2961-0a0e-4d37-b977-c4838cb960fe,network=Network(d955ee3f-be94-4165-92f0-5fd5893f50aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ada2961-0a') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ada2961-0a, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ada2961-0a, col_values=(('external_ids', {'iface-id': '4ada2961-0a0e-4d37-b977-c4838cb960fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:7a:5c', 'vm-uuid': 'b71826ea-5fc4-4405-80b2-12e681ebb88a'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:47 user nova-compute[72447]: INFO os_vif [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7a:5c,bridge_name='br-int',has_traffic_filtering=True,id=4ada2961-0a0e-4d37-b977-c4838cb960fe,network=Network(d955ee3f-be94-4165-92f0-5fd5893f50aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ada2961-0a')
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:25:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] No VIF found with MAC fa:16:3e:e7:7a:5c, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:25:48 user nova-compute[72447]: DEBUG nova.network.neutron [req-1cdbb617-c948-45f3-9f8f-c668f4007fcd req-9f996521-4f67-4796-ac6c-cb71f6008104 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Updated VIF entry in instance network info cache for port 4ada2961-0a0e-4d37-b977-c4838cb960fe. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:25:48 user nova-compute[72447]: DEBUG nova.network.neutron [req-1cdbb617-c948-45f3-9f8f-c668f4007fcd req-9f996521-4f67-4796-ac6c-cb71f6008104 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Updating instance_info_cache with network_info: [{"id": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "address": "fa:16:3e:e7:7a:5c", "network": {"id": "d955ee3f-be94-4165-92f0-5fd5893f50aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-955978129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09317a99770b41abaa8ba73252e034e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ada2961-0a", "ovs_interfaceid": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:25:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1cdbb617-c948-45f3-9f8f-c668f4007fcd req-9f996521-4f67-4796-ac6c-cb71f6008104 service nova] Releasing lock "refresh_cache-b71826ea-5fc4-4405-80b2-12e681ebb88a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:25:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-01474592-5a86-4847-a24d-0ce66c1a22a8 req-78e285f7-acc7-453f-9752-5d1b216258bd service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Received event network-vif-plugged-4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:25:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-01474592-5a86-4847-a24d-0ce66c1a22a8 req-78e285f7-acc7-453f-9752-5d1b216258bd service nova] Acquiring lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-01474592-5a86-4847-a24d-0ce66c1a22a8 req-78e285f7-acc7-453f-9752-5d1b216258bd service nova] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-01474592-5a86-4847-a24d-0ce66c1a22a8 req-78e285f7-acc7-453f-9752-5d1b216258bd service nova] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-01474592-5a86-4847-a24d-0ce66c1a22a8 req-78e285f7-acc7-453f-9752-5d1b216258bd service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] No waiting events found dispatching network-vif-plugged-4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:25:49 user nova-compute[72447]: WARNING nova.compute.manager [req-01474592-5a86-4847-a24d-0ce66c1a22a8 req-78e285f7-acc7-453f-9752-5d1b216258bd service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Received unexpected event network-vif-plugged-4ada2961-0a0e-4d37-b977-c4838cb960fe for instance with vm_state building and task_state spawning.
Jul 31 12:25:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806351.3511052, b71826ea-5fc4-4405-80b2-12e681ebb88a => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:25:51 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] VM Resumed (Lifecycle Event)
Jul 31 12:25:51 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Instance spawned successfully.
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:25:51 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806351.352488, b71826ea-5fc4-4405-80b2-12e681ebb88a => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:25:51 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] VM Started (Lifecycle Event)
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:25:51 user nova-compute[72447]: INFO nova.compute.manager [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Took 6.64 seconds to spawn the instance on the hypervisor.
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:25:51 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:25:51 user nova-compute[72447]: INFO nova.compute.manager [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Took 7.66 seconds to build instance.
Jul 31 12:25:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-62cf6538-d1ff-48c3-894b-a23f6997e0a3 tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.768s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-5f8ddc1e-57e4-4963-adab-f0c9d0c6e5ad req-6ca0a143-0cdb-413a-a272-dae614b7ef02 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Received event network-vif-plugged-4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5f8ddc1e-57e4-4963-adab-f0c9d0c6e5ad req-6ca0a143-0cdb-413a-a272-dae614b7ef02 service nova] Acquiring lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5f8ddc1e-57e4-4963-adab-f0c9d0c6e5ad req-6ca0a143-0cdb-413a-a272-dae614b7ef02 service nova] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5f8ddc1e-57e4-4963-adab-f0c9d0c6e5ad req-6ca0a143-0cdb-413a-a272-dae614b7ef02 service nova] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:25:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-5f8ddc1e-57e4-4963-adab-f0c9d0c6e5ad req-6ca0a143-0cdb-413a-a272-dae614b7ef02 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] No waiting events found dispatching network-vif-plugged-4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:25:51 user nova-compute[72447]: WARNING nova.compute.manager [req-5f8ddc1e-57e4-4963-adab-f0c9d0c6e5ad req-6ca0a143-0cdb-413a-a272-dae614b7ef02 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Received unexpected event network-vif-plugged-4ada2961-0a0e-4d37-b977-c4838cb960fe for instance with vm_state active and task_state None.
Jul 31 12:25:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:55 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:25:55 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:25:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:25:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:25:55 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:25:55 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Updating instance_info_cache with network_info: [{"id": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "address": "fa:16:3e:4e:fc:4a", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a18de-e6", "ovs_interfaceid": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:25:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:25:55 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:25:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:25:58 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:25:58 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:25:58 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:25:59 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:25:59 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:26:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:26:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:06 user nova-compute[72447]: INFO nova.compute.manager [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Terminating instance
Jul 31 12:26:06 user nova-compute[72447]: DEBUG nova.compute.manager [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-f52c6f76-3785-42f3-a1cd-622e0a0ab1a7 req-949d8dbd-9678-4148-9122-1f590ab356c1 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-unplugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f52c6f76-3785-42f3-a1cd-622e0a0ab1a7 req-949d8dbd-9678-4148-9122-1f590ab356c1 service nova] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f52c6f76-3785-42f3-a1cd-622e0a0ab1a7 req-949d8dbd-9678-4148-9122-1f590ab356c1 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f52c6f76-3785-42f3-a1cd-622e0a0ab1a7 req-949d8dbd-9678-4148-9122-1f590ab356c1 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-f52c6f76-3785-42f3-a1cd-622e0a0ab1a7 req-949d8dbd-9678-4148-9122-1f590ab356c1 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] No waiting events found dispatching network-vif-unplugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-f52c6f76-3785-42f3-a1cd-622e0a0ab1a7 req-949d8dbd-9678-4148-9122-1f590ab356c1 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-unplugged-8cdc2eae-9d44-4619-ad18-98196a439f15 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Instance destroyed successfully.
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'resources' on Instance uuid 483f6f7a-c61d-46dd-893b-29b80da3f54d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:26:07 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:26:07 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7194MB free_disk=25.095966339111328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1804070957',display_name='tempest-ServerRescueNegativeTestJSON-server-1804070957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1804070957',id=25,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU7ZXwiFgzMg8a44RrreO/XqYZIUmOE9iTP5kDtijALfeDKpqhlIcg6kobJqoZmCLWC/4Ey6eC7psG7UL1cAoLuos4YGl7QXWEIFfzxxS7LeUI4v+hNMWA7z/BWm7VB9w==',key_name='tempest-keypair-1226214134',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:21:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9576e1abb5b1475da061ca824d7c3788',ramdisk_id='',reservation_id='r-fjjnoqc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2103641702',owner_user_name='tempest-ServerRescueNegativeTestJSON-2103641702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:23:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbcdd571b45b4450a8b27b834a05a2b6',uuid=483f6f7a-c61d-46dd-893b-29b80da3f54d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converting VIF {"id": "8cdc2eae-9d44-4619-ad18-98196a439f15", "address": "fa:16:3e:53:b0:0f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdc2eae-9d", "ovs_interfaceid": "8cdc2eae-9d44-4619-ad18-98196a439f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:b0:0f,bridge_name='br-int',has_traffic_filtering=True,id=8cdc2eae-9d44-4619-ad18-98196a439f15,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdc2eae-9d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG os_vif [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:b0:0f,bridge_name='br-int',has_traffic_filtering=True,id=8cdc2eae-9d44-4619-ad18-98196a439f15,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdc2eae-9d') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cdc2eae-9d, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:26:07 user nova-compute[72447]: INFO os_vif [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:b0:0f,bridge_name='br-int',has_traffic_filtering=True,id=8cdc2eae-9d44-4619-ad18-98196a439f15,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdc2eae-9d')
Jul 31 12:26:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Deleting instance files /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d_del
Jul 31 12:26:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Deletion of /opt/stack/data/nova/instances/483f6f7a-c61d-46dd-893b-29b80da3f54d_del complete
Jul 31 12:26:07 user nova-compute[72447]: INFO nova.compute.manager [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Took 1.34 seconds to destroy the instance on the hypervisor.
Jul 31 12:26:07 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b5fe9835-8278-449e-9069-18421cb088dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 483f6f7a-c61d-46dd-893b-29b80da3f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance f3f1534b-16c0-4dee-b78c-d53713113a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2a481721-232b-4a4d-83ad-cfbac144bb5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b71826ea-5fc4-4405-80b2-12e681ebb88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:26:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-4081bfeb-8315-47b3-bfe3-dc080752d4e0 req-571820a7-0964-42b1-9cf5-495a3911abb8 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:26:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4081bfeb-8315-47b3-bfe3-dc080752d4e0 req-571820a7-0964-42b1-9cf5-495a3911abb8 service nova] Acquiring lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4081bfeb-8315-47b3-bfe3-dc080752d4e0 req-571820a7-0964-42b1-9cf5-495a3911abb8 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4081bfeb-8315-47b3-bfe3-dc080752d4e0 req-571820a7-0964-42b1-9cf5-495a3911abb8 service nova] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-4081bfeb-8315-47b3-bfe3-dc080752d4e0 req-571820a7-0964-42b1-9cf5-495a3911abb8 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] No waiting events found dispatching network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:26:08 user nova-compute[72447]: WARNING nova.compute.manager [req-4081bfeb-8315-47b3-bfe3-dc080752d4e0 req-571820a7-0964-42b1-9cf5-495a3911abb8 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received unexpected event network-vif-plugged-8cdc2eae-9d44-4619-ad18-98196a439f15 for instance with vm_state active and task_state deleting.
Jul 31 12:26:08 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:26:08 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:26:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:09 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:26:09 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Took 1.72 seconds to deallocate network for instance.
Jul 31 12:26:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-d032d85b-bbfb-4f43-b334-a48e0bdc436c req-535c2a95-e435-4f37-9954-270479841305 service nova] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Received event network-vif-deleted-8cdc2eae-9d44-4619-ad18-98196a439f15 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:26:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:09 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:26:09 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:26:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:09 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Deleted allocations for instance 483f6f7a-c61d-46dd-893b-29b80da3f54d
Jul 31 12:26:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e725a87d-9396-43af-8209-d6db20ff400d tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "483f6f7a-c61d-46dd-893b-29b80da3f54d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.713s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:26:11 user nova-compute[72447]: INFO nova.compute.manager [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] instance snapshotting
Jul 31 12:26:11 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Beginning live snapshot process
Jul 31 12:26:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json -f qcow2 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json -f qcow2 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgv4g4683/2a906a812c8c4b77b347379af5396084.delta 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgv4g4683/2a906a812c8c4b77b347379af5396084.delta 1073741824" returned: 0 in 0.049s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:12 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 12:26:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:26:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:26:13 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 12:26:14 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:26:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgv4g4683/2a906a812c8c4b77b347379af5396084.delta /opt/stack/data/nova/instances/snapshots/tmpgv4g4683/2a906a812c8c4b77b347379af5396084 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgv4g4683/2a906a812c8c4b77b347379af5396084.delta /opt/stack/data/nova/instances/snapshots/tmpgv4g4683/2a906a812c8c4b77b347379af5396084" returned: 0 in 0.434s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:14 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Snapshot extracted, beginning image upload
Jul 31 12:26:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:17 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Snapshot image upload complete
Jul 31 12:26:17 user nova-compute[72447]: INFO nova.compute.manager [None req-fc59bc45-f521-4e8f-9151-50aa968716c2 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Took 5.34 seconds to snapshot the instance on the hypervisor.
Jul 31 12:26:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:26:21 user nova-compute[72447]: INFO nova.compute.claims [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Claim successful on node user
Jul 31 12:26:21 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:26:21 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:26:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG nova.policy [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c7a178f684246608fded95196469c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e21ac0a7354b85bcbe334edfc00fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:26:21 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Creating image(s)
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "/opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "/opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.130s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.130s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk 1073741824" returned: 0 in 0.052s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806366.9228354, 483f6f7a-c61d-46dd-893b-29b80da3f54d => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:26:22 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] VM Stopped (Lifecycle Event)
Jul 31 12:26:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6bb603c7-8933-41f6-aa11-ee189d935a4b None None] [instance: 483f6f7a-c61d-46dd-893b-29b80da3f54d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Cannot resize image /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lazy-loading 'migration_context' on Instance uuid c8aaf2f0-737d-4523-9e7a-12237bc41a74 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Ensure instance console log exists: /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Successfully created port: c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Successfully updated port: c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "refresh_cache-c8aaf2f0-737d-4523-9e7a-12237bc41a74" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquired lock "refresh_cache-c8aaf2f0-737d-4523-9e7a-12237bc41a74" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-2212a83d-6e3a-40ff-861c-ca41a9e0166d req-b3b02385-3fd8-4154-a0b3-2905b450581e service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Received event network-changed-c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-2212a83d-6e3a-40ff-861c-ca41a9e0166d req-b3b02385-3fd8-4154-a0b3-2905b450581e service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Refreshing instance network info cache due to event network-changed-c606bcee-7fcd-4b69-93c1-772af333b4f2. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2212a83d-6e3a-40ff-861c-ca41a9e0166d req-b3b02385-3fd8-4154-a0b3-2905b450581e service nova] Acquiring lock "refresh_cache-c8aaf2f0-737d-4523-9e7a-12237bc41a74" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Updating instance_info_cache with network_info: [{"id": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "address": "fa:16:3e:60:00:91", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606bcee-7f", "ovs_interfaceid": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Releasing lock "refresh_cache-c8aaf2f0-737d-4523-9e7a-12237bc41a74" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Instance network_info: |[{"id": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "address": "fa:16:3e:60:00:91", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606bcee-7f", "ovs_interfaceid": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2212a83d-6e3a-40ff-861c-ca41a9e0166d req-b3b02385-3fd8-4154-a0b3-2905b450581e service nova] Acquired lock "refresh_cache-c8aaf2f0-737d-4523-9e7a-12237bc41a74" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.network.neutron [req-2212a83d-6e3a-40ff-861c-ca41a9e0166d req-b3b02385-3fd8-4154-a0b3-2905b450581e service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Refreshing network info cache for port c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Start _get_guest_xml network_info=[{"id": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "address": "fa:16:3e:60:00:91", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606bcee-7f", "ovs_interfaceid": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:26:23 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:26:23 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:26:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1574384154',display_name='tempest-VolumesActionsTest-instance-1574384154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1574384154',id=34,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49e21ac0a7354b85bcbe334edfc00fd5',ramdisk_id='',reservation_id='r-p02a0o8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-489730423',owner_user_name='tempest-VolumesActionsTest-489730423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:26:22Z,user_data=None,user_id='1c7a178f684246608fded95196469c0f',uuid=c8aaf2f0-737d-4523-9e7a-12237bc41a74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "address": "fa:16:3e:60:00:91", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606bcee-7f", "ovs_interfaceid": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Converting VIF {"id": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "address": "fa:16:3e:60:00:91", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606bcee-7f", "ovs_interfaceid": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:00:91,bridge_name='br-int',has_traffic_filtering=True,id=c606bcee-7fcd-4b69-93c1-772af333b4f2,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606bcee-7f') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lazy-loading 'pci_devices' on Instance uuid c8aaf2f0-737d-4523-9e7a-12237bc41a74 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:26:23 user nova-compute[72447]:   <uuid>c8aaf2f0-737d-4523-9e7a-12237bc41a74</uuid>
Jul 31 12:26:23 user nova-compute[72447]:   <name>instance-00000022</name>
Jul 31 12:26:23 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:26:23 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:26:23 user nova-compute[72447]:   <metadata>
Jul 31 12:26:23 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:26:23 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:26:23 user nova-compute[72447]:       <nova:name>tempest-VolumesActionsTest-instance-1574384154</nova:name>
Jul 31 12:26:23 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:26:23</nova:creationTime>
Jul 31 12:26:23 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:26:23 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:26:23 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:26:23 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:26:23 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:26:23 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:26:23 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:26:23 user nova-compute[72447]:       <nova:owner>
Jul 31 12:26:23 user nova-compute[72447]:         <nova:user uuid="1c7a178f684246608fded95196469c0f">tempest-VolumesActionsTest-489730423-project-member</nova:user>
Jul 31 12:26:23 user nova-compute[72447]:         <nova:project uuid="49e21ac0a7354b85bcbe334edfc00fd5">tempest-VolumesActionsTest-489730423</nova:project>
Jul 31 12:26:23 user nova-compute[72447]:       </nova:owner>
Jul 31 12:26:23 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:26:23 user nova-compute[72447]:       <nova:ports>
Jul 31 12:26:23 user nova-compute[72447]:         <nova:port uuid="c606bcee-7fcd-4b69-93c1-772af333b4f2">
Jul 31 12:26:23 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 12:26:23 user nova-compute[72447]:         </nova:port>
Jul 31 12:26:23 user nova-compute[72447]:       </nova:ports>
Jul 31 12:26:23 user nova-compute[72447]:     </nova:instance>
Jul 31 12:26:23 user nova-compute[72447]:   </metadata>
Jul 31 12:26:23 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:26:23 user nova-compute[72447]:     <system>
Jul 31 12:26:23 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:26:23 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:26:23 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:26:23 user nova-compute[72447]:       <entry name="serial">c8aaf2f0-737d-4523-9e7a-12237bc41a74</entry>
Jul 31 12:26:23 user nova-compute[72447]:       <entry name="uuid">c8aaf2f0-737d-4523-9e7a-12237bc41a74</entry>
Jul 31 12:26:23 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:26:23 user nova-compute[72447]:     </system>
Jul 31 12:26:23 user nova-compute[72447]:   </sysinfo>
Jul 31 12:26:23 user nova-compute[72447]:   <os>
Jul 31 12:26:23 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:26:23 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:26:23 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:26:23 user nova-compute[72447]:   </os>
Jul 31 12:26:23 user nova-compute[72447]:   <features>
Jul 31 12:26:23 user nova-compute[72447]:     <acpi/>
Jul 31 12:26:23 user nova-compute[72447]:     <apic/>
Jul 31 12:26:23 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:26:23 user nova-compute[72447]:   </features>
Jul 31 12:26:23 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:26:23 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:26:23 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:26:23 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:26:23 user nova-compute[72447]:   </clock>
Jul 31 12:26:23 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:26:23 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:26:23 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:26:23 user nova-compute[72447]:   </cpu>
Jul 31 12:26:23 user nova-compute[72447]:   <devices>
Jul 31 12:26:23 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:26:23 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:26:23 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk"/>
Jul 31 12:26:23 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:26:23 user nova-compute[72447]:     </disk>
Jul 31 12:26:23 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:26:23 user nova-compute[72447]:       <mac address="fa:16:3e:60:00:91"/>
Jul 31 12:26:23 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:26:23 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:26:23 user nova-compute[72447]:       <target dev="tapc606bcee-7f"/>
Jul 31 12:26:23 user nova-compute[72447]:     </interface>
Jul 31 12:26:23 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:26:23 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/console.log" append="off"/>
Jul 31 12:26:23 user nova-compute[72447]:     </serial>
Jul 31 12:26:23 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:26:23 user nova-compute[72447]:     <video>
Jul 31 12:26:23 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:26:23 user nova-compute[72447]:     </video>
Jul 31 12:26:23 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:26:23 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:26:23 user nova-compute[72447]:     </rng>
Jul 31 12:26:23 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:26:23 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:26:23 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:26:23 user nova-compute[72447]:     </memballoon>
Jul 31 12:26:23 user nova-compute[72447]:   </devices>
Jul 31 12:26:23 user nova-compute[72447]: </domain>
Jul 31 12:26:23 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:26:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1574384154',display_name='tempest-VolumesActionsTest-instance-1574384154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1574384154',id=34,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49e21ac0a7354b85bcbe334edfc00fd5',ramdisk_id='',reservation_id='r-p02a0o8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-489730423',owner_user_name='tempest-VolumesActionsTest-489730423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:26:22Z,user_data=None,user_id='1c7a178f684246608fded95196469c0f',uuid=c8aaf2f0-737d-4523-9e7a-12237bc41a74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "address": "fa:16:3e:60:00:91", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606bcee-7f", "ovs_interfaceid": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Converting VIF {"id": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "address": "fa:16:3e:60:00:91", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606bcee-7f", "ovs_interfaceid": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:00:91,bridge_name='br-int',has_traffic_filtering=True,id=c606bcee-7fcd-4b69-93c1-772af333b4f2,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606bcee-7f') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG os_vif [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:00:91,bridge_name='br-int',has_traffic_filtering=True,id=c606bcee-7fcd-4b69-93c1-772af333b4f2,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606bcee-7f') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc606bcee-7f, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc606bcee-7f, col_values=(('external_ids', {'iface-id': 'c606bcee-7fcd-4b69-93c1-772af333b4f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:00:91', 'vm-uuid': 'c8aaf2f0-737d-4523-9e7a-12237bc41a74'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:26:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:23 user nova-compute[72447]: INFO os_vif [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:00:91,bridge_name='br-int',has_traffic_filtering=True,id=c606bcee-7fcd-4b69-93c1-772af333b4f2,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606bcee-7f')
Jul 31 12:26:24 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:26:24 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] No VIF found with MAC fa:16:3e:60:00:91, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:26:24 user nova-compute[72447]: DEBUG nova.network.neutron [req-2212a83d-6e3a-40ff-861c-ca41a9e0166d req-b3b02385-3fd8-4154-a0b3-2905b450581e service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Updated VIF entry in instance network info cache for port c606bcee-7fcd-4b69-93c1-772af333b4f2. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:26:24 user nova-compute[72447]: DEBUG nova.network.neutron [req-2212a83d-6e3a-40ff-861c-ca41a9e0166d req-b3b02385-3fd8-4154-a0b3-2905b450581e service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Updating instance_info_cache with network_info: [{"id": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "address": "fa:16:3e:60:00:91", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606bcee-7f", "ovs_interfaceid": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:26:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2212a83d-6e3a-40ff-861c-ca41a9e0166d req-b3b02385-3fd8-4154-a0b3-2905b450581e service nova] Releasing lock "refresh_cache-c8aaf2f0-737d-4523-9e7a-12237bc41a74" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:26:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-cfdea07e-1df7-46fe-94c2-4c2705182abc req-9042b82c-4c68-46b3-9ac7-2a706e35ceb5 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Received event network-vif-plugged-c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:26:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cfdea07e-1df7-46fe-94c2-4c2705182abc req-9042b82c-4c68-46b3-9ac7-2a706e35ceb5 service nova] Acquiring lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cfdea07e-1df7-46fe-94c2-4c2705182abc req-9042b82c-4c68-46b3-9ac7-2a706e35ceb5 service nova] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cfdea07e-1df7-46fe-94c2-4c2705182abc req-9042b82c-4c68-46b3-9ac7-2a706e35ceb5 service nova] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-cfdea07e-1df7-46fe-94c2-4c2705182abc req-9042b82c-4c68-46b3-9ac7-2a706e35ceb5 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] No waiting events found dispatching network-vif-plugged-c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:26:25 user nova-compute[72447]: WARNING nova.compute.manager [req-cfdea07e-1df7-46fe-94c2-4c2705182abc req-9042b82c-4c68-46b3-9ac7-2a706e35ceb5 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Received unexpected event network-vif-plugged-c606bcee-7fcd-4b69-93c1-772af333b4f2 for instance with vm_state building and task_state spawning.
Jul 31 12:26:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806387.5787792, c8aaf2f0-737d-4523-9e7a-12237bc41a74 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:26:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] VM Resumed (Lifecycle Event)
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:26:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Instance spawned successfully.
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:26:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806387.5835788, c8aaf2f0-737d-4523-9e7a-12237bc41a74 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:26:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] VM Started (Lifecycle Event)
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:26:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:26:27 user nova-compute[72447]: INFO nova.compute.manager [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Took 5.98 seconds to spawn the instance on the hypervisor.
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:26:27 user nova-compute[72447]: INFO nova.compute.manager [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Took 6.72 seconds to build instance.
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-955271d0-4ee6-41a7-ae60-c40e633a630c req-0fdef87a-5574-44ae-977f-f07b85cd5857 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Received event network-vif-plugged-c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-955271d0-4ee6-41a7-ae60-c40e633a630c req-0fdef87a-5574-44ae-977f-f07b85cd5857 service nova] Acquiring lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-955271d0-4ee6-41a7-ae60-c40e633a630c req-0fdef87a-5574-44ae-977f-f07b85cd5857 service nova] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-955271d0-4ee6-41a7-ae60-c40e633a630c req-0fdef87a-5574-44ae-977f-f07b85cd5857 service nova] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-955271d0-4ee6-41a7-ae60-c40e633a630c req-0fdef87a-5574-44ae-977f-f07b85cd5857 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] No waiting events found dispatching network-vif-plugged-c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:26:27 user nova-compute[72447]: WARNING nova.compute.manager [req-955271d0-4ee6-41a7-ae60-c40e633a630c req-0fdef87a-5574-44ae-977f-f07b85cd5857 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Received unexpected event network-vif-plugged-c606bcee-7fcd-4b69-93c1-772af333b4f2 for instance with vm_state active and task_state None.
Jul 31 12:26:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5ea4efea-58fa-4f7b-a698-a6659d9f8289 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.833s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-5bffb697-9b78-4f0d-a873-04ac7f681c28 req-0553f5c3-a6f2-42ee-a157-240c19c009b1 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-changed-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:26:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-5bffb697-9b78-4f0d-a873-04ac7f681c28 req-0553f5c3-a6f2-42ee-a157-240c19c009b1 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Refreshing instance network info cache due to event network-changed-69b9e7de-13a8-4339-b2df-8547ea668cd7. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:26:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5bffb697-9b78-4f0d-a873-04ac7f681c28 req-0553f5c3-a6f2-42ee-a157-240c19c009b1 service nova] Acquiring lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:26:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5bffb697-9b78-4f0d-a873-04ac7f681c28 req-0553f5c3-a6f2-42ee-a157-240c19c009b1 service nova] Acquired lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:26:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-5bffb697-9b78-4f0d-a873-04ac7f681c28 req-0553f5c3-a6f2-42ee-a157-240c19c009b1 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Refreshing network info cache for port 69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:26:32 user nova-compute[72447]: DEBUG nova.network.neutron [req-5bffb697-9b78-4f0d-a873-04ac7f681c28 req-0553f5c3-a6f2-42ee-a157-240c19c009b1 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updated VIF entry in instance network info cache for port 69b9e7de-13a8-4339-b2df-8547ea668cd7. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:26:32 user nova-compute[72447]: DEBUG nova.network.neutron [req-5bffb697-9b78-4f0d-a873-04ac7f681c28 req-0553f5c3-a6f2-42ee-a157-240c19c009b1 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updating instance_info_cache with network_info: [{"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:26:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5bffb697-9b78-4f0d-a873-04ac7f681c28 req-0553f5c3-a6f2-42ee-a157-240c19c009b1 service nova] Releasing lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:26:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:32 user nova-compute[72447]: INFO nova.compute.manager [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Detaching volume f5403d03-f9b9-4c5f-b5ee-ade0e5580e16
Jul 31 12:26:32 user nova-compute[72447]: INFO nova.virt.block_device [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Attempting to driver detach volume f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 from mountpoint /dev/vdb
Jul 31 12:26:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Attempting to detach device vdb from instance 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:26:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:26:32 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:26:32 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:26:32 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:26:32 user nova-compute[72447]:   <serial>f5403d03-f9b9-4c5f-b5ee-ade0e5580e16</serial>
Jul 31 12:26:32 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:26:32 user nova-compute[72447]: </disk>
Jul 31 12:26:32 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:26:32 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Successfully detached device vdb from instance 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa from the persistent domain config.
Jul 31 12:26:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:26:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:26:32 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:26:32 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:26:32 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:26:32 user nova-compute[72447]:   <serial>f5403d03-f9b9-4c5f-b5ee-ade0e5580e16</serial>
Jul 31 12:26:32 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:26:32 user nova-compute[72447]: </disk>
Jul 31 12:26:32 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806393.3532517, 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:26:33 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Successfully detached device vdb from instance 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa from the live domain config.
Jul 31 12:26:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnPtrNkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:26:33 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e8cdee-1f58-4153-abc8-d2fd4b8c29a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fe47aa-7983-4e66-8711-b45747af5017]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:26:33 user nova-compute[72447]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)
Jul 31 12:26:33 user nova-compute[72447]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:26:33 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:26:33 user nova-compute[72447]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 (non-flash)
Jul 31 12:26:33 user nova-compute[72447]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:26:33 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f064872ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16'): ({'sde'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Removing single pathed devices sde {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[078b4b9e-5a15-485d-9ec1-9762001760c0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed67535b-8da6-434d-8207-9cd5b7eca167]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Flushing IO for device /dev/sde {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[84071b7d-d944-4f2b-9ad4-b66633d8c8f3]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacdca72-177c-4f6d-b5b2-47459d7fbfe3]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec72589-44db-4620-8330-1d2ed6f89383]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d839a309-1aeb-4809-85cc-2edf5d356b9d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16, portal: 172.16.0.220,3260]
Jul 31 12:26:33 user nova-compute[72447]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16, portal: 172.16.0.220,3260] successful.
Jul 31 12:26:33 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5403d03-f9b9-4c5f-b5ee-ade0e5580e16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6137560-91c9-4328-8ce8-81f8eafabc4f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] <== disconnect_volume: return (282ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-17b2807d-efa6-4b63-8767-2123c49ddecc req-65bcfa1d-ae49-4147-b4c0-e4a24cdc423f service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-changed-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-17b2807d-efa6-4b63-8767-2123c49ddecc req-65bcfa1d-ae49-4147-b4c0-e4a24cdc423f service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Refreshing instance network info cache due to event network-changed-69b9e7de-13a8-4339-b2df-8547ea668cd7. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-17b2807d-efa6-4b63-8767-2123c49ddecc req-65bcfa1d-ae49-4147-b4c0-e4a24cdc423f service nova] Acquiring lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-17b2807d-efa6-4b63-8767-2123c49ddecc req-65bcfa1d-ae49-4147-b4c0-e4a24cdc423f service nova] Acquired lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG nova.network.neutron [req-17b2807d-efa6-4b63-8767-2123c49ddecc req-65bcfa1d-ae49-4147-b4c0-e4a24cdc423f service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Refreshing network info cache for port 69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:26:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:34 user nova-compute[72447]: DEBUG nova.network.neutron [req-17b2807d-efa6-4b63-8767-2123c49ddecc req-65bcfa1d-ae49-4147-b4c0-e4a24cdc423f service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updated VIF entry in instance network info cache for port 69b9e7de-13a8-4339-b2df-8547ea668cd7. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:26:34 user nova-compute[72447]: DEBUG nova.network.neutron [req-17b2807d-efa6-4b63-8767-2123c49ddecc req-65bcfa1d-ae49-4147-b4c0-e4a24cdc423f service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updating instance_info_cache with network_info: [{"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:26:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-17b2807d-efa6-4b63-8767-2123c49ddecc req-65bcfa1d-ae49-4147-b4c0-e4a24cdc423f service nova] Releasing lock "refresh_cache-12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:26:34 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'flavor' on Instance uuid 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:26:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3e076134-79b8-4555-9183-b135eaca2890 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.658s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:26:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:26:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:26:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:26:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:26:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-753cc067-8993-4378-bd5f-be95c5a89aa5 req-8c2ec26b-d364-4f09-a407-18ee61ba2920 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-changed-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:26:46 user nova-compute[72447]: DEBUG nova.compute.manager [req-753cc067-8993-4378-bd5f-be95c5a89aa5 req-8c2ec26b-d364-4f09-a407-18ee61ba2920 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Refreshing instance network info cache due to event network-changed-fe243daf-4d07-48dd-84c9-1252c65085ed. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:26:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-753cc067-8993-4378-bd5f-be95c5a89aa5 req-8c2ec26b-d364-4f09-a407-18ee61ba2920 service nova] Acquiring lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:26:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-753cc067-8993-4378-bd5f-be95c5a89aa5 req-8c2ec26b-d364-4f09-a407-18ee61ba2920 service nova] Acquired lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:26:46 user nova-compute[72447]: DEBUG nova.network.neutron [req-753cc067-8993-4378-bd5f-be95c5a89aa5 req-8c2ec26b-d364-4f09-a407-18ee61ba2920 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Refreshing network info cache for port fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:26:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-6e7feae5-70b5-4f42-ab12-306c127fe59b req-60038ccd-e634-42b9-ae96-791f029b6096 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received event network-changed-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:26:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-6e7feae5-70b5-4f42-ab12-306c127fe59b req-60038ccd-e634-42b9-ae96-791f029b6096 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Refreshing instance network info cache due to event network-changed-b1cb45da-a35d-45d4-90a1-031caf0f3c84. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:26:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6e7feae5-70b5-4f42-ab12-306c127fe59b req-60038ccd-e634-42b9-ae96-791f029b6096 service nova] Acquiring lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:26:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6e7feae5-70b5-4f42-ab12-306c127fe59b req-60038ccd-e634-42b9-ae96-791f029b6096 service nova] Acquired lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:26:48 user nova-compute[72447]: DEBUG nova.network.neutron [req-6e7feae5-70b5-4f42-ab12-306c127fe59b req-60038ccd-e634-42b9-ae96-791f029b6096 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Refreshing network info cache for port b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:26:48 user nova-compute[72447]: DEBUG nova.network.neutron [req-753cc067-8993-4378-bd5f-be95c5a89aa5 req-8c2ec26b-d364-4f09-a407-18ee61ba2920 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updated VIF entry in instance network info cache for port fe243daf-4d07-48dd-84c9-1252c65085ed. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:26:48 user nova-compute[72447]: DEBUG nova.network.neutron [req-753cc067-8993-4378-bd5f-be95c5a89aa5 req-8c2ec26b-d364-4f09-a407-18ee61ba2920 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updating instance_info_cache with network_info: [{"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:26:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-753cc067-8993-4378-bd5f-be95c5a89aa5 req-8c2ec26b-d364-4f09-a407-18ee61ba2920 service nova] Releasing lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:26:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Stashing vm_state: active {{(pid=72447) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 31 12:26:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:49 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'pci_requests' on Instance uuid 2a481721-232b-4a4d-83ad-cfbac144bb5e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:26:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:26:49 user nova-compute[72447]: INFO nova.compute.claims [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Claim successful on node user
Jul 31 12:26:49 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'resources' on Instance uuid 2a481721-232b-4a4d-83ad-cfbac144bb5e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:26:49 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a481721-232b-4a4d-83ad-cfbac144bb5e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:26:49 user nova-compute[72447]: INFO nova.compute.resource_tracker [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updating resource usage from migration 80bd52de-365a-4151-9be1-e6372710ef40
Jul 31 12:26:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG nova.network.neutron [req-6e7feae5-70b5-4f42-ab12-306c127fe59b req-60038ccd-e634-42b9-ae96-791f029b6096 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updated VIF entry in instance network info cache for port b1cb45da-a35d-45d4-90a1-031caf0f3c84. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG nova.network.neutron [req-6e7feae5-70b5-4f42-ab12-306c127fe59b req-60038ccd-e634-42b9-ae96-791f029b6096 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updating instance_info_cache with network_info: [{"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6e7feae5-70b5-4f42-ab12-306c127fe59b req-60038ccd-e634-42b9-ae96-791f029b6096 service nova] Releasing lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.592s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:50 user nova-compute[72447]: INFO nova.compute.manager [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Migrating
Jul 31 12:26:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquired lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updating instance_info_cache with network_info: [{"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Releasing lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Starting migrate_disk_and_power_off {{(pid=72447) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-d5dd1b12-5a37-49eb-98d4-d206b2cbc3a0 req-d12fa135-1aad-484a-b491-45e78cf2faa3 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received event network-vif-unplugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d5dd1b12-5a37-49eb-98d4-d206b2cbc3a0 req-d12fa135-1aad-484a-b491-45e78cf2faa3 service nova] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d5dd1b12-5a37-49eb-98d4-d206b2cbc3a0 req-d12fa135-1aad-484a-b491-45e78cf2faa3 service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d5dd1b12-5a37-49eb-98d4-d206b2cbc3a0 req-d12fa135-1aad-484a-b491-45e78cf2faa3 service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-d5dd1b12-5a37-49eb-98d4-d206b2cbc3a0 req-d12fa135-1aad-484a-b491-45e78cf2faa3 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] No waiting events found dispatching network-vif-unplugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:26:51 user nova-compute[72447]: WARNING nova.compute.manager [req-d5dd1b12-5a37-49eb-98d4-d206b2cbc3a0 req-d12fa135-1aad-484a-b491-45e78cf2faa3 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received unexpected event network-vif-unplugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 for instance with vm_state active and task_state resize_migrating.
Jul 31 12:26:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:26:51 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Instance destroyed successfully.
Jul 31 12:26:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-13195892',display_name='tempest-ServerActionsTestOtherA-server-13195892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-13195892',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWDGihKbMeCNvBwsaW6V6P8R5lowbGENHMAc92pWv6O2vQFLobOnEOvb/OjxIDRXej4CqXst6J0oTtwIiGi8MF4pETlYJBg2aTwKoMBAuzDXV9HfutMu8dkCAol0vT0Q==',key_name='tempest-keypair-1212175094',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:25:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='25afa936e9674cce91443f7bef7409ab',ramdisk_id='',reservation_id='r-lnqp7hno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1904418117',owner_user_name='tempest-ServerActionsTestOtherA-1904418117-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:26:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfd7290fb1a45b7a27cfb5faa08cc5d',uuid=2a481721-232b-4a4d-83ad-cfbac144bb5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2107779541-network", "vif_mac": "fa:16:3e:cd:ae:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converting VIF {"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2107779541-network", "vif_mac": "fa:16:3e:cd:ae:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_vif [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1cb45da-a3, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:51 user nova-compute[72447]: INFO os_vif [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3')
Jul 31 12:26:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQxtpKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:26:51 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb395d0-f4a3-4149-aab6-6edbd9086e82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1d4d53-d1d6-40f1-b22f-10520132499a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:26:51 user nova-compute[72447]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:26:51 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:26:51 user nova-compute[72447]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:26:51 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0648793eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351'): ({'sdd'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Removing single pathed devices sdd {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71d3c73-6cc9-4636-b0e9-c98c91b33975]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ce4a61-3bde-4ffc-907d-f51925b5b828]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Flushing IO for device /dev/sdd {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[693df36f-68c6-4272-a274-56a1673fdb90]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f8979e-24b1-48f5-805e-be6f8a75acc1]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23634663634663564', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5d123343', '/dev/disk/by-id/scsi-1SCST_BIO5d123343-64f64f5d0b449d25') {{(pid=83492) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c130be-d22a-4e06-aecd-2913697141a7]: (4, None) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1756635-6991-4dda-a58a-7a07e8e84ace]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e5dea4-444b-4238-8a8a-b78546f54cbe]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260]
Jul 31 12:26:51 user nova-compute[72447]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260] successful.
Jul 31 12:26:51 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:26:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4689786c-7551-48db-88df-32506612e5af]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:26:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:26:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== disconnect_volume: return (319ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:26:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:26:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:26:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:53 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Port b1cb45da-a35d-45d4-90a1-031caf0f3c84 binding to destination host user is already ACTIVE {{(pid=72447) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 31 12:26:53 user nova-compute[72447]: DEBUG nova.compute.manager [req-5fd3d18a-29c7-4078-98d1-9af255e4d943 req-05607964-8db0-4fc3-82a9-e5216a50718c service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received event network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:26:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5fd3d18a-29c7-4078-98d1-9af255e4d943 req-05607964-8db0-4fc3-82a9-e5216a50718c service nova] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5fd3d18a-29c7-4078-98d1-9af255e4d943 req-05607964-8db0-4fc3-82a9-e5216a50718c service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5fd3d18a-29c7-4078-98d1-9af255e4d943 req-05607964-8db0-4fc3-82a9-e5216a50718c service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:53 user nova-compute[72447]: DEBUG nova.compute.manager [req-5fd3d18a-29c7-4078-98d1-9af255e4d943 req-05607964-8db0-4fc3-82a9-e5216a50718c service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] No waiting events found dispatching network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:26:53 user nova-compute[72447]: WARNING nova.compute.manager [req-5fd3d18a-29c7-4078-98d1-9af255e4d943 req-05607964-8db0-4fc3-82a9-e5216a50718c service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received unexpected event network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 for instance with vm_state active and task_state resize_migrating.
Jul 31 12:26:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:26:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:26:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquired lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:26:53 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updating instance_info_cache with network_info: [{"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Releasing lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG os_brick.utils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[94323b26-830a-4117-95da-193645c9a1d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[569f2c76-0b39-41bf-98b8-84dbe259078d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[745ac7b7-048c-49d3-8d16-1a705e21c6c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa57bd5-fef8-4e9d-bf03-4678e951a30d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:26:54 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:26:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f6576a-1822-4653-90d6-b10f5cb061c9]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:26:54 user nova-compute[72447]: DEBUG os_brick.utils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:26:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:55 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:26:56 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:26:56 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:26:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:26:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:26:56 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:26:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:57 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updating instance_info_cache with network_info: [{"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:26:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:26:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:26:57 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:26:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72447) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 12:26:59 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:26:59 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:26:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:26:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "cf664b3e-d48f-45d1-b47e-53e81c769054" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:26:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:26:59 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:27:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:00 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:27:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:00 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:27:00 user nova-compute[72447]: INFO nova.compute.claims [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Claim successful on node user
Jul 31 12:27:00 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Refreshing inventories for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 12:27:00 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Updating ProviderTree inventory for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 12:27:00 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 12:27:00 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Refreshing aggregate associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, aggregates: None {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 12:27:00 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Refreshing trait associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.866s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:27:01 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:27:01 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Creating image(s)
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "/opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "/opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG nova.policy [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9517e4295d8c4e22a09e193f9687811c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46c90a8c1f42aeb9e63db6aa240ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.172s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.204s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk 1073741824" returned: 0 in 0.055s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.194s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:02 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:27:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:02 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Cannot resize image /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:27:02 user nova-compute[72447]: DEBUG nova.objects.instance [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lazy-loading 'migration_context' on Instance uuid cf664b3e-d48f-45d1-b47e-53e81c769054 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:27:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:27:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Ensure instance console log exists: /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:27:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Successfully created port: e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Starting finish_migration {{(pid=72447) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Instance directory exists: not creating {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 12:27:03 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Creating image(s)
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Ensure instance console log exists: /opt/stack/data/nova/instances/2a481721-232b-4a4d-83ad-cfbac144bb5e/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Start _get_guest_xml network_info=[{"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2107779541-network", "vif_mac": "fa:16:3e:cd:ae:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'f4ab1023-5b90-4678-8d2d-5e396951220d', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQxtpKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2a481721-232b-4a4d-83ad-cfbac144bb5e', 'attached_at': '2023-07-31T12:27:03.000000', 'detached_at': '', 'volume_id': '96012daf-491b-4fec-be48-6beaf6b1d351', 'serial': '96012daf-491b-4fec-be48-6beaf6b1d351'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:27:03 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:27:03 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a481721-232b-4a4d-83ad-cfbac144bb5e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQxtpKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:27:03 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:27:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:27:03 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:27:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:27:03 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4e620f-9afe-4cba-94f1-7a5b8452d544]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:27:03 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0057a0a-1b26-476e-8293-745e182c6f1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351] added
Jul 31 12:27:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5306d5-b9b4-4e7c-916c-0d20ec730111]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ce25ce-71f9-4fd8-9622-37b1fbaf1901]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQxtpKyv {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQxtpKyv" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4020798-bbb0-4314-9a1e-6ce536584681]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wQxtpKyv'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc7ae75-17b3-46a3-b9c2-3511c3a4c08a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[81879d87-01b6-422c-bd97-ca5defcff978]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7d9f07-45a8-4896-9656-d1074c92cea5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260]
Jul 31 12:27:04 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260] successful.
Jul 31 12:27:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0e092b-9ba0-420c-b38a-a99f97a7b2ba]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f23d146-8464-43c6-bff9-31a38b9bff77]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:04 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:27:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:04 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:27:04 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c533bbef-c199-48a2-ae50-86c3fc3e53cf]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQxtpKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Successfully updated port: e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "refresh_cache-cf664b3e-d48f-45d1-b47e-53e81c769054" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquired lock "refresh_cache-cf664b3e-d48f-45d1-b47e-53e81c769054" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-717c247e-893c-4ede-a3ca-00fdc813fa66 req-8c11dc03-2a61-4bcf-831f-6572f6b23c04 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Received event network-changed-e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-717c247e-893c-4ede-a3ca-00fdc813fa66 req-8c11dc03-2a61-4bcf-831f-6572f6b23c04 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Refreshing instance network info cache due to event network-changed-e553a5d8-d071-4c12-995b-74d2cf9d343c. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:27:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-717c247e-893c-4ede-a3ca-00fdc813fa66 req-8c11dc03-2a61-4bcf-831f-6572f6b23c04 service nova] Acquiring lock "refresh_cache-cf664b3e-d48f-45d1-b47e-53e81c769054" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23634663634663564', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634663634663564', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Updating instance_info_cache with network_info: [{"id": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "address": "fa:16:3e:0c:f8:c3", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape553a5d8-d0", "ovs_interfaceid": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Releasing lock "refresh_cache-cf664b3e-d48f-45d1-b47e-53e81c769054" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Instance network_info: |[{"id": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "address": "fa:16:3e:0c:f8:c3", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape553a5d8-d0", "ovs_interfaceid": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-13195892',display_name='tempest-ServerActionsTestOtherA-server-13195892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-13195892',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWDGihKbMeCNvBwsaW6V6P8R5lowbGENHMAc92pWv6O2vQFLobOnEOvb/OjxIDRXej4CqXst6J0oTtwIiGi8MF4pETlYJBg2aTwKoMBAuzDXV9HfutMu8dkCAol0vT0Q==',key_name='tempest-keypair-1212175094',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:25:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='25afa936e9674cce91443f7bef7409ab',ramdisk_id='',reservation_id='r-lnqp7hno',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1904418117',owner_user_name='tempest-ServerActionsTestOtherA-1904418117-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfd7290fb1a45b7a27cfb5faa08cc5d',uuid=2a481721-232b-4a4d-83ad-cfbac144bb5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2107779541-network", "vif_mac": "fa:16:3e:cd:ae:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converting VIF {"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2107779541-network", "vif_mac": "fa:16:3e:cd:ae:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:27:05 user nova-compute[72447]:   <uuid>2a481721-232b-4a4d-83ad-cfbac144bb5e</uuid>
Jul 31 12:27:05 user nova-compute[72447]:   <name>instance-00000020</name>
Jul 31 12:27:05 user nova-compute[72447]:   <memory>2097152</memory>
Jul 31 12:27:05 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:27:05 user nova-compute[72447]:   <metadata>
Jul 31 12:27:05 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:27:05 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:27:05 user nova-compute[72447]:       <nova:name>tempest-ServerActionsTestOtherA-server-13195892</nova:name>
Jul 31 12:27:05 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:27:03</nova:creationTime>
Jul 31 12:27:05 user nova-compute[72447]:       <nova:flavor name="m1.small">
Jul 31 12:27:05 user nova-compute[72447]:         <nova:memory>2048</nova:memory>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:disk>20</nova:disk>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:27:05 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:27:05 user nova-compute[72447]:       <nova:owner>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:user uuid="0bfd7290fb1a45b7a27cfb5faa08cc5d">tempest-ServerActionsTestOtherA-1904418117-project-member</nova:user>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:project uuid="25afa936e9674cce91443f7bef7409ab">tempest-ServerActionsTestOtherA-1904418117</nova:project>
Jul 31 12:27:05 user nova-compute[72447]:       </nova:owner>
Jul 31 12:27:05 user nova-compute[72447]:       <nova:ports>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:port uuid="b1cb45da-a35d-45d4-90a1-031caf0f3c84">
Jul 31 12:27:05 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 12:27:05 user nova-compute[72447]:         </nova:port>
Jul 31 12:27:05 user nova-compute[72447]:       </nova:ports>
Jul 31 12:27:05 user nova-compute[72447]:     </nova:instance>
Jul 31 12:27:05 user nova-compute[72447]:   </metadata>
Jul 31 12:27:05 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:27:05 user nova-compute[72447]:     <system>
Jul 31 12:27:05 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:27:05 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:27:05 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:27:05 user nova-compute[72447]:       <entry name="serial">2a481721-232b-4a4d-83ad-cfbac144bb5e</entry>
Jul 31 12:27:05 user nova-compute[72447]:       <entry name="uuid">2a481721-232b-4a4d-83ad-cfbac144bb5e</entry>
Jul 31 12:27:05 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:27:05 user nova-compute[72447]:     </system>
Jul 31 12:27:05 user nova-compute[72447]:   </sysinfo>
Jul 31 12:27:05 user nova-compute[72447]:   <os>
Jul 31 12:27:05 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:27:05 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:27:05 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:27:05 user nova-compute[72447]:   </os>
Jul 31 12:27:05 user nova-compute[72447]:   <features>
Jul 31 12:27:05 user nova-compute[72447]:     <acpi/>
Jul 31 12:27:05 user nova-compute[72447]:     <apic/>
Jul 31 12:27:05 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:27:05 user nova-compute[72447]:   </features>
Jul 31 12:27:05 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:27:05 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:27:05 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:27:05 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:27:05 user nova-compute[72447]:   </clock>
Jul 31 12:27:05 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:27:05 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:27:05 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:27:05 user nova-compute[72447]:   </cpu>
Jul 31 12:27:05 user nova-compute[72447]:   <devices>
Jul 31 12:27:05 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:27:05 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:27:05 user nova-compute[72447]:       <source dev="/dev/sdb"/>
Jul 31 12:27:05 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:27:05 user nova-compute[72447]:       <serial>96012daf-491b-4fec-be48-6beaf6b1d351</serial>
Jul 31 12:27:05 user nova-compute[72447]:     </disk>
Jul 31 12:27:05 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:27:05 user nova-compute[72447]:       <mac address="fa:16:3e:cd:ae:8c"/>
Jul 31 12:27:05 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:27:05 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:27:05 user nova-compute[72447]:       <target dev="tapb1cb45da-a3"/>
Jul 31 12:27:05 user nova-compute[72447]:     </interface>
Jul 31 12:27:05 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:27:05 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/2a481721-232b-4a4d-83ad-cfbac144bb5e/console.log" append="off"/>
Jul 31 12:27:05 user nova-compute[72447]:     </serial>
Jul 31 12:27:05 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:27:05 user nova-compute[72447]:     <video>
Jul 31 12:27:05 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:27:05 user nova-compute[72447]:     </video>
Jul 31 12:27:05 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:27:05 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:27:05 user nova-compute[72447]:     </rng>
Jul 31 12:27:05 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:27:05 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:27:05 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:27:05 user nova-compute[72447]:     </memballoon>
Jul 31 12:27:05 user nova-compute[72447]:   </devices>
Jul 31 12:27:05 user nova-compute[72447]: </domain>
Jul 31 12:27:05 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-13195892',display_name='tempest-ServerActionsTestOtherA-server-13195892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-13195892',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWDGihKbMeCNvBwsaW6V6P8R5lowbGENHMAc92pWv6O2vQFLobOnEOvb/OjxIDRXej4CqXst6J0oTtwIiGi8MF4pETlYJBg2aTwKoMBAuzDXV9HfutMu8dkCAol0vT0Q==',key_name='tempest-keypair-1212175094',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:25:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='25afa936e9674cce91443f7bef7409ab',ramdisk_id='',reservation_id='r-lnqp7hno',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1904418117',owner_user_name='tempest-ServerActionsTestOtherA-1904418117-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfd7290fb1a45b7a27cfb5faa08cc5d',uuid=2a481721-232b-4a4d-83ad-cfbac144bb5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2107779541-network", "vif_mac": "fa:16:3e:cd:ae:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converting VIF {"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2107779541-network", "vif_mac": "fa:16:3e:cd:ae:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG os_vif [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-717c247e-893c-4ede-a3ca-00fdc813fa66 req-8c11dc03-2a61-4bcf-831f-6572f6b23c04 service nova] Acquired lock "refresh_cache-cf664b3e-d48f-45d1-b47e-53e81c769054" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.network.neutron [req-717c247e-893c-4ede-a3ca-00fdc813fa66 req-8c11dc03-2a61-4bcf-831f-6572f6b23c04 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Refreshing network info cache for port e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Start _get_guest_xml network_info=[{"id": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "address": "fa:16:3e:0c:f8:c3", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape553a5d8-d0", "ovs_interfaceid": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1cb45da-a3, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1cb45da-a3, col_values=(('external_ids', {'iface-id': 'b1cb45da-a35d-45d4-90a1-031caf0f3c84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:ae:8c', 'vm-uuid': '2a481721-232b-4a4d-83ad-cfbac144bb5e'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:05 user nova-compute[72447]: INFO os_vif [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3')
Jul 31 12:27:05 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:27:05 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1509750683',display_name='tempest-VolumesSnapshotTestJSON-instance-1509750683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1509750683',id=35,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+xTS03T73IadZ7tuAOTDBd5Y4FbmE353IOrcxkqMBJUtjwsCpLOP6BPq4Jga+T2/qOUlMblkYjATbft8IbmP0NVDI848Wb4sy50gfCljOVIG7HT8ZFA+tojOC2es88mA==',key_name='tempest-keypair-1039769747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c46c90a8c1f42aeb9e63db6aa240ab5',ramdisk_id='',reservation_id='r-ptnii213',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1298774726',owner_user_name='tempest-VolumesSnapshotTestJSON-1298774726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9517e4295d8c4e22a09e193f9687811c',uuid=cf664b3e-d48f-45d1-b47e-53e81c769054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "address": "fa:16:3e:0c:f8:c3", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape553a5d8-d0", "ovs_interfaceid": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Converting VIF {"id": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "address": "fa:16:3e:0c:f8:c3", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape553a5d8-d0", "ovs_interfaceid": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f8:c3,bridge_name='br-int',has_traffic_filtering=True,id=e553a5d8-d071-4c12-995b-74d2cf9d343c,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape553a5d8-d0') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.objects.instance [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lazy-loading 'pci_devices' on Instance uuid cf664b3e-d48f-45d1-b47e-53e81c769054 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:27:05 user nova-compute[72447]:   <uuid>cf664b3e-d48f-45d1-b47e-53e81c769054</uuid>
Jul 31 12:27:05 user nova-compute[72447]:   <name>instance-00000023</name>
Jul 31 12:27:05 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:27:05 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:27:05 user nova-compute[72447]:   <metadata>
Jul 31 12:27:05 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:27:05 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:27:05 user nova-compute[72447]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1509750683</nova:name>
Jul 31 12:27:05 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:27:05</nova:creationTime>
Jul 31 12:27:05 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:27:05 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:27:05 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:27:05 user nova-compute[72447]:       <nova:owner>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:user uuid="9517e4295d8c4e22a09e193f9687811c">tempest-VolumesSnapshotTestJSON-1298774726-project-member</nova:user>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:project uuid="4c46c90a8c1f42aeb9e63db6aa240ab5">tempest-VolumesSnapshotTestJSON-1298774726</nova:project>
Jul 31 12:27:05 user nova-compute[72447]:       </nova:owner>
Jul 31 12:27:05 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:27:05 user nova-compute[72447]:       <nova:ports>
Jul 31 12:27:05 user nova-compute[72447]:         <nova:port uuid="e553a5d8-d071-4c12-995b-74d2cf9d343c">
Jul 31 12:27:05 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 12:27:05 user nova-compute[72447]:         </nova:port>
Jul 31 12:27:05 user nova-compute[72447]:       </nova:ports>
Jul 31 12:27:05 user nova-compute[72447]:     </nova:instance>
Jul 31 12:27:05 user nova-compute[72447]:   </metadata>
Jul 31 12:27:05 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:27:05 user nova-compute[72447]:     <system>
Jul 31 12:27:05 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:27:05 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:27:05 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:27:05 user nova-compute[72447]:       <entry name="serial">cf664b3e-d48f-45d1-b47e-53e81c769054</entry>
Jul 31 12:27:05 user nova-compute[72447]:       <entry name="uuid">cf664b3e-d48f-45d1-b47e-53e81c769054</entry>
Jul 31 12:27:05 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:27:05 user nova-compute[72447]:     </system>
Jul 31 12:27:05 user nova-compute[72447]:   </sysinfo>
Jul 31 12:27:05 user nova-compute[72447]:   <os>
Jul 31 12:27:05 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:27:05 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:27:05 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:27:05 user nova-compute[72447]:   </os>
Jul 31 12:27:05 user nova-compute[72447]:   <features>
Jul 31 12:27:05 user nova-compute[72447]:     <acpi/>
Jul 31 12:27:05 user nova-compute[72447]:     <apic/>
Jul 31 12:27:05 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:27:05 user nova-compute[72447]:   </features>
Jul 31 12:27:05 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:27:05 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:27:05 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:27:05 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:27:05 user nova-compute[72447]:   </clock>
Jul 31 12:27:05 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:27:05 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:27:05 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:27:05 user nova-compute[72447]:   </cpu>
Jul 31 12:27:05 user nova-compute[72447]:   <devices>
Jul 31 12:27:05 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:27:05 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:27:05 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk"/>
Jul 31 12:27:05 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:27:05 user nova-compute[72447]:     </disk>
Jul 31 12:27:05 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:27:05 user nova-compute[72447]:       <mac address="fa:16:3e:0c:f8:c3"/>
Jul 31 12:27:05 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:27:05 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:27:05 user nova-compute[72447]:       <target dev="tape553a5d8-d0"/>
Jul 31 12:27:05 user nova-compute[72447]:     </interface>
Jul 31 12:27:05 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:27:05 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/console.log" append="off"/>
Jul 31 12:27:05 user nova-compute[72447]:     </serial>
Jul 31 12:27:05 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:27:05 user nova-compute[72447]:     <video>
Jul 31 12:27:05 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:27:05 user nova-compute[72447]:     </video>
Jul 31 12:27:05 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:27:05 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:27:05 user nova-compute[72447]:     </rng>
Jul 31 12:27:05 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:27:05 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:27:05 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:27:05 user nova-compute[72447]:     </memballoon>
Jul 31 12:27:05 user nova-compute[72447]:   </devices>
Jul 31 12:27:05 user nova-compute[72447]: </domain>
Jul 31 12:27:05 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1509750683',display_name='tempest-VolumesSnapshotTestJSON-instance-1509750683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1509750683',id=35,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+xTS03T73IadZ7tuAOTDBd5Y4FbmE353IOrcxkqMBJUtjwsCpLOP6BPq4Jga+T2/qOUlMblkYjATbft8IbmP0NVDI848Wb4sy50gfCljOVIG7HT8ZFA+tojOC2es88mA==',key_name='tempest-keypair-1039769747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c46c90a8c1f42aeb9e63db6aa240ab5',ramdisk_id='',reservation_id='r-ptnii213',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1298774726',owner_user_name='tempest-VolumesSnapshotTestJSON-1298774726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9517e4295d8c4e22a09e193f9687811c',uuid=cf664b3e-d48f-45d1-b47e-53e81c769054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "address": "fa:16:3e:0c:f8:c3", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape553a5d8-d0", "ovs_interfaceid": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Converting VIF {"id": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "address": "fa:16:3e:0c:f8:c3", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape553a5d8-d0", "ovs_interfaceid": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f8:c3,bridge_name='br-int',has_traffic_filtering=True,id=e553a5d8-d071-4c12-995b-74d2cf9d343c,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape553a5d8-d0') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG os_vif [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f8:c3,bridge_name='br-int',has_traffic_filtering=True,id=e553a5d8-d071-4c12-995b-74d2cf9d343c,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape553a5d8-d0') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape553a5d8-d0, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape553a5d8-d0, col_values=(('external_ids', {'iface-id': 'e553a5d8-d071-4c12-995b-74d2cf9d343c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:f8:c3', 'vm-uuid': 'cf664b3e-d48f-45d1-b47e-53e81c769054'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:05 user nova-compute[72447]: INFO os_vif [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f8:c3,bridge_name='br-int',has_traffic_filtering=True,id=e553a5d8-d071-4c12-995b-74d2cf9d343c,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape553a5d8-d0')
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] No VIF found with MAC fa:16:3e:cd:ae:8c, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] No VIF found with MAC fa:16:3e:0c:f8:c3, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-717c247e-893c-4ede-a3ca-00fdc813fa66 req-8c11dc03-2a61-4bcf-831f-6572f6b23c04 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Updated VIF entry in instance network info cache for port e553a5d8-d071-4c12-995b-74d2cf9d343c. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-717c247e-893c-4ede-a3ca-00fdc813fa66 req-8c11dc03-2a61-4bcf-831f-6572f6b23c04 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Updating instance_info_cache with network_info: [{"id": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "address": "fa:16:3e:0c:f8:c3", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape553a5d8-d0", "ovs_interfaceid": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-717c247e-893c-4ede-a3ca-00fdc813fa66 req-8c11dc03-2a61-4bcf-831f-6572f6b23c04 service nova] Releasing lock "refresh_cache-cf664b3e-d48f-45d1-b47e-53e81c769054" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:27:06 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806411.6652844, 2a481721-232b-4a4d-83ad-cfbac144bb5e => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:27:06 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] VM Stopped (Lifecycle Event)
Jul 31 12:27:06 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6612fb9b-a443-4fb7-b9f7-bc4a90247ee2 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-dfbfb61d-32a4-43e8-9038-ee456ab37274 req-3305982d-28c8-4cb5-8f4e-fd146e34ae10 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received event network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-dfbfb61d-32a4-43e8-9038-ee456ab37274 req-3305982d-28c8-4cb5-8f4e-fd146e34ae10 service nova] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-dfbfb61d-32a4-43e8-9038-ee456ab37274 req-3305982d-28c8-4cb5-8f4e-fd146e34ae10 service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-dfbfb61d-32a4-43e8-9038-ee456ab37274 req-3305982d-28c8-4cb5-8f4e-fd146e34ae10 service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-dfbfb61d-32a4-43e8-9038-ee456ab37274 req-3305982d-28c8-4cb5-8f4e-fd146e34ae10 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] No waiting events found dispatching network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:08 user nova-compute[72447]: WARNING nova.compute.manager [req-dfbfb61d-32a4-43e8-9038-ee456ab37274 req-3305982d-28c8-4cb5-8f4e-fd146e34ae10 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received unexpected event network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 for instance with vm_state active and task_state resize_finish.
Jul 31 12:27:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-f0891450-c9fe-4e6b-b992-1289e097a99f req-a5be6fc2-c158-4902-ad6d-802dea295124 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Received event network-vif-plugged-e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f0891450-c9fe-4e6b-b992-1289e097a99f req-a5be6fc2-c158-4902-ad6d-802dea295124 service nova] Acquiring lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f0891450-c9fe-4e6b-b992-1289e097a99f req-a5be6fc2-c158-4902-ad6d-802dea295124 service nova] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f0891450-c9fe-4e6b-b992-1289e097a99f req-a5be6fc2-c158-4902-ad6d-802dea295124 service nova] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-f0891450-c9fe-4e6b-b992-1289e097a99f req-a5be6fc2-c158-4902-ad6d-802dea295124 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] No waiting events found dispatching network-vif-plugged-e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:08 user nova-compute[72447]: WARNING nova.compute.manager [req-f0891450-c9fe-4e6b-b992-1289e097a99f req-a5be6fc2-c158-4902-ad6d-802dea295124 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Received unexpected event network-vif-plugged-e553a5d8-d071-4c12-995b-74d2cf9d343c for instance with vm_state building and task_state spawning.
Jul 31 12:27:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:27:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:10 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:27:10 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7350MB free_disk=25.00374984741211GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Applying migration context for instance 2a481721-232b-4a4d-83ad-cfbac144bb5e as it has an incoming, in-progress migration 80bd52de-365a-4151-9be1-e6372710ef40. Migration status is post-migrating {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 12:27:10 user nova-compute[72447]: INFO nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updating resource usage from migration 80bd52de-365a-4151-9be1-e6372710ef40
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b5fe9835-8278-449e-9069-18421cb088dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance f3f1534b-16c0-4dee-b78c-d53713113a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b71826ea-5fc4-4405-80b2-12e681ebb88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance c8aaf2f0-737d-4523-9e7a-12237bc41a74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Migration 80bd52de-365a-4151-9be1-e6372710ef40 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2a481721-232b-4a4d-83ad-cfbac144bb5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance cf664b3e-d48f-45d1-b47e-53e81c769054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-e519365d-6dc3-453f-8311-b56aaaac5f96 req-869e041f-2aa8-4cb7-8f1c-01b4839173f2 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received event network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e519365d-6dc3-453f-8311-b56aaaac5f96 req-869e041f-2aa8-4cb7-8f1c-01b4839173f2 service nova] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e519365d-6dc3-453f-8311-b56aaaac5f96 req-869e041f-2aa8-4cb7-8f1c-01b4839173f2 service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e519365d-6dc3-453f-8311-b56aaaac5f96 req-869e041f-2aa8-4cb7-8f1c-01b4839173f2 service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-e519365d-6dc3-453f-8311-b56aaaac5f96 req-869e041f-2aa8-4cb7-8f1c-01b4839173f2 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] No waiting events found dispatching network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:10 user nova-compute[72447]: WARNING nova.compute.manager [req-e519365d-6dc3-453f-8311-b56aaaac5f96 req-869e041f-2aa8-4cb7-8f1c-01b4839173f2 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received unexpected event network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 for instance with vm_state active and task_state resize_finish.
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-d52061ae-508a-4779-a3ea-63b832fe2890 req-0d7d481f-be21-4c27-b282-a1ec776c9694 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Received event network-vif-plugged-e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d52061ae-508a-4779-a3ea-63b832fe2890 req-0d7d481f-be21-4c27-b282-a1ec776c9694 service nova] Acquiring lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d52061ae-508a-4779-a3ea-63b832fe2890 req-0d7d481f-be21-4c27-b282-a1ec776c9694 service nova] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d52061ae-508a-4779-a3ea-63b832fe2890 req-0d7d481f-be21-4c27-b282-a1ec776c9694 service nova] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-d52061ae-508a-4779-a3ea-63b832fe2890 req-0d7d481f-be21-4c27-b282-a1ec776c9694 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] No waiting events found dispatching network-vif-plugged-e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:10 user nova-compute[72447]: WARNING nova.compute.manager [req-d52061ae-508a-4779-a3ea-63b832fe2890 req-0d7d481f-be21-4c27-b282-a1ec776c9694 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Received unexpected event network-vif-plugged-e553a5d8-d071-4c12-995b-74d2cf9d343c for instance with vm_state building and task_state spawning.
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.982s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806431.3324816, 2a481721-232b-4a4d-83ad-cfbac144bb5e => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:27:11 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] VM Resumed (Lifecycle Event)
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:27:11 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Instance running successfully.
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Failed to set time: agent not configured {{(pid=72447) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6ae9ded2-7cd1-469c-9ca9-33c26f1406f8 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] finish_migration finished successfully. {{(pid=72447) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:27:11 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806431.33399, 2a481721-232b-4a4d-83ad-cfbac144bb5e => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:27:11 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] VM Started (Lifecycle Event)
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:27:11 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806431.484301, cf664b3e-d48f-45d1-b47e-53e81c769054 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:27:11 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] VM Resumed (Lifecycle Event)
Jul 31 12:27:11 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Instance spawned successfully.
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:11 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806431.4845238, cf664b3e-d48f-45d1-b47e-53e81c769054 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:27:11 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] VM Started (Lifecycle Event)
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:27:11 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:27:11 user nova-compute[72447]: INFO nova.compute.manager [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Took 10.30 seconds to spawn the instance on the hypervisor.
Jul 31 12:27:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:11 user nova-compute[72447]: INFO nova.compute.manager [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Took 11.79 seconds to build instance.
Jul 31 12:27:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1c34eefd-92b2-415a-9745-5093b8fc096c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.918s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:13 user nova-compute[72447]: INFO nova.compute.manager [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Terminating instance
Jul 31 12:27:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-de4b7933-c902-4fae-8585-bc54c66a6337 req-93b022b5-6115-481b-9027-ccf0dd8804f2 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received event network-vif-unplugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-de4b7933-c902-4fae-8585-bc54c66a6337 req-93b022b5-6115-481b-9027-ccf0dd8804f2 service nova] Acquiring lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-de4b7933-c902-4fae-8585-bc54c66a6337 req-93b022b5-6115-481b-9027-ccf0dd8804f2 service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-de4b7933-c902-4fae-8585-bc54c66a6337 req-93b022b5-6115-481b-9027-ccf0dd8804f2 service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-de4b7933-c902-4fae-8585-bc54c66a6337 req-93b022b5-6115-481b-9027-ccf0dd8804f2 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] No waiting events found dispatching network-vif-unplugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-de4b7933-c902-4fae-8585-bc54c66a6337 req-93b022b5-6115-481b-9027-ccf0dd8804f2 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received event network-vif-unplugged-8e631d77-6caf-4106-8a95-8f90c2e6417d for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] There are 0 instances to clean {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 12:27:14 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Instance destroyed successfully.
Jul 31 12:27:14 user nova-compute[72447]: DEBUG nova.objects.instance [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'resources' on Instance uuid 00c9825b-0cc3-4c07-87bf-bffaabe4c265 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-126637251',display_name='tempest-ServerRescueNegativeTestJSON-server-126637251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-126637251',id=2,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9576e1abb5b1475da061ca824d7c3788',ramdisk_id='',reservation_id='r-upw6bz0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2103641702',owner_user_name='tempest-ServerRescueNegativeTestJSON-2103641702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:12:54Z,user_data=None,user_id='cbcdd571b45b4450a8b27b834a05a2b6',uuid=00c9825b-0cc3-4c07-87bf-bffaabe4c265,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converting VIF {"id": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "address": "fa:16:3e:8f:e3:9f", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e631d77-6c", "ovs_interfaceid": "8e631d77-6caf-4106-8a95-8f90c2e6417d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:e3:9f,bridge_name='br-int',has_traffic_filtering=True,id=8e631d77-6caf-4106-8a95-8f90c2e6417d,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e631d77-6c') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG os_vif [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:e3:9f,bridge_name='br-int',has_traffic_filtering=True,id=8e631d77-6caf-4106-8a95-8f90c2e6417d,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e631d77-6c') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e631d77-6c, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:27:14 user nova-compute[72447]: INFO os_vif [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:e3:9f,bridge_name='br-int',has_traffic_filtering=True,id=8e631d77-6caf-4106-8a95-8f90c2e6417d,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e631d77-6c')
Jul 31 12:27:14 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Deleting instance files /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265_del
Jul 31 12:27:14 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Deletion of /opt/stack/data/nova/instances/00c9825b-0cc3-4c07-87bf-bffaabe4c265_del complete
Jul 31 12:27:14 user nova-compute[72447]: INFO nova.compute.manager [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Took 1.00 seconds to destroy the instance on the hypervisor.
Jul 31 12:27:14 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:27:14 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:27:15 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:27:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:15 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Took 0.61 seconds to deallocate network for instance.
Jul 31 12:27:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:15 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:27:15 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:27:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.673s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:15 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Deleted allocations for instance 00c9825b-0cc3-4c07-87bf-bffaabe4c265
Jul 31 12:27:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-427a9e4b-504f-46c9-8295-50044c00a788 tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.548s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:16 user nova-compute[72447]: DEBUG nova.compute.manager [req-ff4adb82-5b44-4f65-ac11-5203182db3c8 req-bafad390-ff9a-436c-afcc-89b07ffd2fc9 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received event network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ff4adb82-5b44-4f65-ac11-5203182db3c8 req-bafad390-ff9a-436c-afcc-89b07ffd2fc9 service nova] Acquiring lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ff4adb82-5b44-4f65-ac11-5203182db3c8 req-bafad390-ff9a-436c-afcc-89b07ffd2fc9 service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ff4adb82-5b44-4f65-ac11-5203182db3c8 req-bafad390-ff9a-436c-afcc-89b07ffd2fc9 service nova] Lock "00c9825b-0cc3-4c07-87bf-bffaabe4c265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:16 user nova-compute[72447]: DEBUG nova.compute.manager [req-ff4adb82-5b44-4f65-ac11-5203182db3c8 req-bafad390-ff9a-436c-afcc-89b07ffd2fc9 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] No waiting events found dispatching network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:16 user nova-compute[72447]: WARNING nova.compute.manager [req-ff4adb82-5b44-4f65-ac11-5203182db3c8 req-bafad390-ff9a-436c-afcc-89b07ffd2fc9 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received unexpected event network-vif-plugged-8e631d77-6caf-4106-8a95-8f90c2e6417d for instance with vm_state deleted and task_state None.
Jul 31 12:27:16 user nova-compute[72447]: DEBUG nova.compute.manager [req-ff4adb82-5b44-4f65-ac11-5203182db3c8 req-bafad390-ff9a-436c-afcc-89b07ffd2fc9 service nova] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Received event network-vif-deleted-8e631d77-6caf-4106-8a95-8f90c2e6417d {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Acquiring lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:27:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:19 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:27:19 user nova-compute[72447]: INFO nova.compute.claims [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Claim successful on node user
Jul 31 12:27:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:19 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:27:19 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:27:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:27:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:27:19 user nova-compute[72447]: DEBUG nova.network.neutron [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:27:19 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:27:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:27:20 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Creating image(s)
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Acquiring lock "/opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "/opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "/opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.145s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG nova.policy [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e75eb0b88444fb7a7076d0fad355b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ef5d9b809b4c809bbb0d80475ccc01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk 1073741824" returned: 0 in 0.061s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.167s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Cannot resize image /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG nova.objects.instance [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lazy-loading 'migration_context' on Instance uuid 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Ensure instance console log exists: /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:27:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:21 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:27:21 user nova-compute[72447]: INFO nova.compute.claims [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Claim successful on node user
Jul 31 12:27:21 user nova-compute[72447]: DEBUG nova.network.neutron [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Successfully created port: 908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:27:21 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:27:21 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:27:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.670s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:27:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:27:21 user nova-compute[72447]: DEBUG nova.network.neutron [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:27:21 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:27:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:27:21 user nova-compute[72447]: INFO nova.virt.block_device [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Booting with volume-backed-image e1118021-a8cd-4e2b-b5b6-62d0c4085b6e at /dev/vda
Jul 31 12:27:22 user nova-compute[72447]: DEBUG nova.policy [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33268392189342ecbca53c9ad959245e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a055fae579aa4858867824625e8bd18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:27:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Successfully updated port: 908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:27:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Acquiring lock "refresh_cache-36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:27:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Acquired lock "refresh_cache-36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:27:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:27:22 user nova-compute[72447]: DEBUG nova.compute.manager [req-ec8cd499-77b8-4c4a-b919-9a6cd9f57c3a req-558bed93-2a1a-4c39-8228-97e399eca74b service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Received event network-changed-908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:22 user nova-compute[72447]: DEBUG nova.compute.manager [req-ec8cd499-77b8-4c4a-b919-9a6cd9f57c3a req-558bed93-2a1a-4c39-8228-97e399eca74b service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Refreshing instance network info cache due to event network-changed-908a0ded-2797-4c92-9591-aad6875b3e6b. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:27:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ec8cd499-77b8-4c4a-b919-9a6cd9f57c3a req-558bed93-2a1a-4c39-8228-97e399eca74b service nova] Acquiring lock "refresh_cache-36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:27:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Updating instance_info_cache with network_info: [{"id": "908a0ded-2797-4c92-9591-aad6875b3e6b", "address": "fa:16:3e:be:e0:2f", "network": {"id": "289d41ce-5531-498b-ab8c-8ca1dec728f4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b939df8aa3284b29bb9a09babf15f826", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a0ded-27", "ovs_interfaceid": "908a0ded-2797-4c92-9591-aad6875b3e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Successfully created port: 82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Releasing lock "refresh_cache-36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.compute.manager [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Instance network_info: |[{"id": "908a0ded-2797-4c92-9591-aad6875b3e6b", "address": "fa:16:3e:be:e0:2f", "network": {"id": "289d41ce-5531-498b-ab8c-8ca1dec728f4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b939df8aa3284b29bb9a09babf15f826", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a0ded-27", "ovs_interfaceid": "908a0ded-2797-4c92-9591-aad6875b3e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ec8cd499-77b8-4c4a-b919-9a6cd9f57c3a req-558bed93-2a1a-4c39-8228-97e399eca74b service nova] Acquired lock "refresh_cache-36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.network.neutron [req-ec8cd499-77b8-4c4a-b919-9a6cd9f57c3a req-558bed93-2a1a-4c39-8228-97e399eca74b service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Refreshing network info cache for port 908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Start _get_guest_xml network_info=[{"id": "908a0ded-2797-4c92-9591-aad6875b3e6b", "address": "fa:16:3e:be:e0:2f", "network": {"id": "289d41ce-5531-498b-ab8c-8ca1dec728f4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b939df8aa3284b29bb9a09babf15f826", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a0ded-27", "ovs_interfaceid": "908a0ded-2797-4c92-9591-aad6875b3e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:27:23 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:27:23 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:27:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1973052574',display_name='tempest-VolumesNegativeTest-instance-1973052574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1973052574',id=36,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ef5d9b809b4c809bbb0d80475ccc01',ramdisk_id='',reservation_id='r-bi2b7pwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-905105624',owner_user_name='tempest-VolumesNegativeTest-905105624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:27:20Z,user_data=None,user_id='6e75eb0b88444fb7a7076d0fad355b27',uuid=36b623bd-370d-4cb5-81e6-0ee3d20ed8a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "908a0ded-2797-4c92-9591-aad6875b3e6b", "address": "fa:16:3e:be:e0:2f", "network": {"id": "289d41ce-5531-498b-ab8c-8ca1dec728f4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b939df8aa3284b29bb9a09babf15f826", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a0ded-27", "ovs_interfaceid": "908a0ded-2797-4c92-9591-aad6875b3e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Converting VIF {"id": "908a0ded-2797-4c92-9591-aad6875b3e6b", "address": "fa:16:3e:be:e0:2f", "network": {"id": "289d41ce-5531-498b-ab8c-8ca1dec728f4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b939df8aa3284b29bb9a09babf15f826", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a0ded-27", "ovs_interfaceid": "908a0ded-2797-4c92-9591-aad6875b3e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:e0:2f,bridge_name='br-int',has_traffic_filtering=True,id=908a0ded-2797-4c92-9591-aad6875b3e6b,network=Network(289d41ce-5531-498b-ab8c-8ca1dec728f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a0ded-27') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.objects.instance [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lazy-loading 'pci_devices' on Instance uuid 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:27:23 user nova-compute[72447]:   <uuid>36b623bd-370d-4cb5-81e6-0ee3d20ed8a4</uuid>
Jul 31 12:27:23 user nova-compute[72447]:   <name>instance-00000024</name>
Jul 31 12:27:23 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:27:23 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:27:23 user nova-compute[72447]:   <metadata>
Jul 31 12:27:23 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:27:23 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:27:23 user nova-compute[72447]:       <nova:name>tempest-VolumesNegativeTest-instance-1973052574</nova:name>
Jul 31 12:27:23 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:27:23</nova:creationTime>
Jul 31 12:27:23 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:27:23 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:27:23 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:27:23 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:27:23 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:27:23 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:27:23 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:27:23 user nova-compute[72447]:       <nova:owner>
Jul 31 12:27:23 user nova-compute[72447]:         <nova:user uuid="6e75eb0b88444fb7a7076d0fad355b27">tempest-VolumesNegativeTest-905105624-project-member</nova:user>
Jul 31 12:27:23 user nova-compute[72447]:         <nova:project uuid="c0ef5d9b809b4c809bbb0d80475ccc01">tempest-VolumesNegativeTest-905105624</nova:project>
Jul 31 12:27:23 user nova-compute[72447]:       </nova:owner>
Jul 31 12:27:23 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:27:23 user nova-compute[72447]:       <nova:ports>
Jul 31 12:27:23 user nova-compute[72447]:         <nova:port uuid="908a0ded-2797-4c92-9591-aad6875b3e6b">
Jul 31 12:27:23 user nova-compute[72447]:           <nova:ip type="fixed" address="192.168.233.134" ipVersion="4"/>
Jul 31 12:27:23 user nova-compute[72447]:         </nova:port>
Jul 31 12:27:23 user nova-compute[72447]:       </nova:ports>
Jul 31 12:27:23 user nova-compute[72447]:     </nova:instance>
Jul 31 12:27:23 user nova-compute[72447]:   </metadata>
Jul 31 12:27:23 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:27:23 user nova-compute[72447]:     <system>
Jul 31 12:27:23 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:27:23 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:27:23 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:27:23 user nova-compute[72447]:       <entry name="serial">36b623bd-370d-4cb5-81e6-0ee3d20ed8a4</entry>
Jul 31 12:27:23 user nova-compute[72447]:       <entry name="uuid">36b623bd-370d-4cb5-81e6-0ee3d20ed8a4</entry>
Jul 31 12:27:23 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:27:23 user nova-compute[72447]:     </system>
Jul 31 12:27:23 user nova-compute[72447]:   </sysinfo>
Jul 31 12:27:23 user nova-compute[72447]:   <os>
Jul 31 12:27:23 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:27:23 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:27:23 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:27:23 user nova-compute[72447]:   </os>
Jul 31 12:27:23 user nova-compute[72447]:   <features>
Jul 31 12:27:23 user nova-compute[72447]:     <acpi/>
Jul 31 12:27:23 user nova-compute[72447]:     <apic/>
Jul 31 12:27:23 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:27:23 user nova-compute[72447]:   </features>
Jul 31 12:27:23 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:27:23 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:27:23 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:27:23 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:27:23 user nova-compute[72447]:   </clock>
Jul 31 12:27:23 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:27:23 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:27:23 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:27:23 user nova-compute[72447]:   </cpu>
Jul 31 12:27:23 user nova-compute[72447]:   <devices>
Jul 31 12:27:23 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:27:23 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:27:23 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk"/>
Jul 31 12:27:23 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:27:23 user nova-compute[72447]:     </disk>
Jul 31 12:27:23 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:27:23 user nova-compute[72447]:       <mac address="fa:16:3e:be:e0:2f"/>
Jul 31 12:27:23 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:27:23 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:27:23 user nova-compute[72447]:       <target dev="tap908a0ded-27"/>
Jul 31 12:27:23 user nova-compute[72447]:     </interface>
Jul 31 12:27:23 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:27:23 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/console.log" append="off"/>
Jul 31 12:27:23 user nova-compute[72447]:     </serial>
Jul 31 12:27:23 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:27:23 user nova-compute[72447]:     <video>
Jul 31 12:27:23 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:27:23 user nova-compute[72447]:     </video>
Jul 31 12:27:23 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:27:23 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:27:23 user nova-compute[72447]:     </rng>
Jul 31 12:27:23 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:27:23 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:27:23 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:27:23 user nova-compute[72447]:     </memballoon>
Jul 31 12:27:23 user nova-compute[72447]:   </devices>
Jul 31 12:27:23 user nova-compute[72447]: </domain>
Jul 31 12:27:23 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:27:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1973052574',display_name='tempest-VolumesNegativeTest-instance-1973052574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1973052574',id=36,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ef5d9b809b4c809bbb0d80475ccc01',ramdisk_id='',reservation_id='r-bi2b7pwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-905105624',owner_user_name='tempest-VolumesNegativeTest-905105624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:27:20Z,user_data=None,user_id='6e75eb0b88444fb7a7076d0fad355b27',uuid=36b623bd-370d-4cb5-81e6-0ee3d20ed8a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "908a0ded-2797-4c92-9591-aad6875b3e6b", "address": "fa:16:3e:be:e0:2f", "network": {"id": "289d41ce-5531-498b-ab8c-8ca1dec728f4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b939df8aa3284b29bb9a09babf15f826", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a0ded-27", "ovs_interfaceid": "908a0ded-2797-4c92-9591-aad6875b3e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Converting VIF {"id": "908a0ded-2797-4c92-9591-aad6875b3e6b", "address": "fa:16:3e:be:e0:2f", "network": {"id": "289d41ce-5531-498b-ab8c-8ca1dec728f4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b939df8aa3284b29bb9a09babf15f826", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a0ded-27", "ovs_interfaceid": "908a0ded-2797-4c92-9591-aad6875b3e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:e0:2f,bridge_name='br-int',has_traffic_filtering=True,id=908a0ded-2797-4c92-9591-aad6875b3e6b,network=Network(289d41ce-5531-498b-ab8c-8ca1dec728f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a0ded-27') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG os_vif [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:e0:2f,bridge_name='br-int',has_traffic_filtering=True,id=908a0ded-2797-4c92-9591-aad6875b3e6b,network=Network(289d41ce-5531-498b-ab8c-8ca1dec728f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a0ded-27') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap908a0ded-27, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap908a0ded-27, col_values=(('external_ids', {'iface-id': '908a0ded-2797-4c92-9591-aad6875b3e6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:e0:2f', 'vm-uuid': '36b623bd-370d-4cb5-81e6-0ee3d20ed8a4'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:23 user nova-compute[72447]: INFO os_vif [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:e0:2f,bridge_name='br-int',has_traffic_filtering=True,id=908a0ded-2797-4c92-9591-aad6875b3e6b,network=Network(289d41ce-5531-498b-ab8c-8ca1dec728f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a0ded-27')
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:27:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] No VIF found with MAC fa:16:3e:be:e0:2f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:27:24 user nova-compute[72447]: DEBUG nova.network.neutron [req-ec8cd499-77b8-4c4a-b919-9a6cd9f57c3a req-558bed93-2a1a-4c39-8228-97e399eca74b service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Updated VIF entry in instance network info cache for port 908a0ded-2797-4c92-9591-aad6875b3e6b. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:27:24 user nova-compute[72447]: DEBUG nova.network.neutron [req-ec8cd499-77b8-4c4a-b919-9a6cd9f57c3a req-558bed93-2a1a-4c39-8228-97e399eca74b service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Updating instance_info_cache with network_info: [{"id": "908a0ded-2797-4c92-9591-aad6875b3e6b", "address": "fa:16:3e:be:e0:2f", "network": {"id": "289d41ce-5531-498b-ab8c-8ca1dec728f4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b939df8aa3284b29bb9a09babf15f826", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a0ded-27", "ovs_interfaceid": "908a0ded-2797-4c92-9591-aad6875b3e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:27:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ec8cd499-77b8-4c4a-b919-9a6cd9f57c3a req-558bed93-2a1a-4c39-8228-97e399eca74b service nova] Releasing lock "refresh_cache-36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG nova.network.neutron [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Successfully updated port: 82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "refresh_cache-6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquired lock "refresh_cache-6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG nova.network.neutron [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-63fe82da-016a-4be4-9290-9934d80f4420 req-d2c2c72b-e82c-4613-9e57-45b5cce575d0 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-changed-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-63fe82da-016a-4be4-9290-9934d80f4420 req-d2c2c72b-e82c-4613-9e57-45b5cce575d0 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Refreshing instance network info cache due to event network-changed-82f2076d-509b-45d4-9ef3-cfc546e01a85. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-63fe82da-016a-4be4-9290-9934d80f4420 req-d2c2c72b-e82c-4613-9e57-45b5cce575d0 service nova] Acquiring lock "refresh_cache-6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG nova.network.neutron [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG nova.network.neutron [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Updating instance_info_cache with network_info: [{"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Releasing lock "refresh_cache-6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Instance network_info: |[{"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-63fe82da-016a-4be4-9290-9934d80f4420 req-d2c2c72b-e82c-4613-9e57-45b5cce575d0 service nova] Acquired lock "refresh_cache-6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG nova.network.neutron [req-63fe82da-016a-4be4-9290-9934d80f4420 req-d2c2c72b-e82c-4613-9e57-45b5cce575d0 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Refreshing network info cache for port 82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-c4f8ee31-470b-4281-a037-a0ab3e920222 req-a6f3536e-8cfe-4082-8acf-7ad8f09894e8 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Received event network-vif-plugged-908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c4f8ee31-470b-4281-a037-a0ab3e920222 req-a6f3536e-8cfe-4082-8acf-7ad8f09894e8 service nova] Acquiring lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c4f8ee31-470b-4281-a037-a0ab3e920222 req-a6f3536e-8cfe-4082-8acf-7ad8f09894e8 service nova] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c4f8ee31-470b-4281-a037-a0ab3e920222 req-a6f3536e-8cfe-4082-8acf-7ad8f09894e8 service nova] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-c4f8ee31-470b-4281-a037-a0ab3e920222 req-a6f3536e-8cfe-4082-8acf-7ad8f09894e8 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] No waiting events found dispatching network-vif-plugged-908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:25 user nova-compute[72447]: WARNING nova.compute.manager [req-c4f8ee31-470b-4281-a037-a0ab3e920222 req-a6f3536e-8cfe-4082-8acf-7ad8f09894e8 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Received unexpected event network-vif-plugged-908a0ded-2797-4c92-9591-aad6875b3e6b for instance with vm_state building and task_state spawning.
Jul 31 12:27:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:26 user nova-compute[72447]: DEBUG nova.network.neutron [req-63fe82da-016a-4be4-9290-9934d80f4420 req-d2c2c72b-e82c-4613-9e57-45b5cce575d0 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Updated VIF entry in instance network info cache for port 82f2076d-509b-45d4-9ef3-cfc546e01a85. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:27:26 user nova-compute[72447]: DEBUG nova.network.neutron [req-63fe82da-016a-4be4-9290-9934d80f4420 req-d2c2c72b-e82c-4613-9e57-45b5cce575d0 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Updating instance_info_cache with network_info: [{"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:27:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-63fe82da-016a-4be4-9290-9934d80f4420 req-d2c2c72b-e82c-4613-9e57-45b5cce575d0 service nova] Releasing lock "refresh_cache-6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806447.6664643, 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:27:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] VM Resumed (Lifecycle Event)
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:27:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Instance spawned successfully.
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806447.6681545, 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:27:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] VM Started (Lifecycle Event)
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:27:27 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:27:27 user nova-compute[72447]: INFO nova.compute.manager [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Took 7.70 seconds to spawn the instance on the hypervisor.
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-ff3d492c-acc1-4a12-81e2-28095c07b8e7 req-4a6557f3-7711-4d85-9e4d-377f72284074 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Received event network-vif-plugged-908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ff3d492c-acc1-4a12-81e2-28095c07b8e7 req-4a6557f3-7711-4d85-9e4d-377f72284074 service nova] Acquiring lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ff3d492c-acc1-4a12-81e2-28095c07b8e7 req-4a6557f3-7711-4d85-9e4d-377f72284074 service nova] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ff3d492c-acc1-4a12-81e2-28095c07b8e7 req-4a6557f3-7711-4d85-9e4d-377f72284074 service nova] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-ff3d492c-acc1-4a12-81e2-28095c07b8e7 req-4a6557f3-7711-4d85-9e4d-377f72284074 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] No waiting events found dispatching network-vif-plugged-908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:27 user nova-compute[72447]: WARNING nova.compute.manager [req-ff3d492c-acc1-4a12-81e2-28095c07b8e7 req-4a6557f3-7711-4d85-9e4d-377f72284074 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Received unexpected event network-vif-plugged-908a0ded-2797-4c92-9591-aad6875b3e6b for instance with vm_state active and task_state None.
Jul 31 12:27:27 user nova-compute[72447]: INFO nova.compute.manager [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Took 8.67 seconds to build instance.
Jul 31 12:27:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-99acf8b6-fef2-4bf0-ab73-dfb689103055 tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.772s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:28 user nova-compute[72447]: INFO nova.compute.manager [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Terminating instance
Jul 31 12:27:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:27:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:29 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806434.2835157, 00c9825b-0cc3-4c07-87bf-bffaabe4c265 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:27:29 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] VM Stopped (Lifecycle Event)
Jul 31 12:27:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-07dd8c72-4da3-4659-9cfc-9e1604d90a61 None None] [instance: 00c9825b-0cc3-4c07-87bf-bffaabe4c265] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Instance destroyed successfully.
Jul 31 12:27:29 user nova-compute[72447]: DEBUG nova.objects.instance [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lazy-loading 'resources' on Instance uuid 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:27:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-528983916',display_name='tempest-TestMinimumBasicScenario-server-528983916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-528983916',id=29,image_ref='068ab2c0-eb0f-418e-bf5c-b80f8416ab91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXWQd7b8R3FDL7h32YpLaEJV+a2YjMmFR2pbrbElCn70KgjvuyTBwxzK4ClGRdvqvKFvF9MQu1fTjG43uJtP4Fb3pDugeDq6/vZiyQ4gSRZV86R+0/OsjSKoxj4OfzRoA==',key_name='tempest-TestMinimumBasicScenario-624029761',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:22:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c212a5254bcc4de290ec4bfbf8fbbd4b',ramdisk_id='',reservation_id='r-1olioo2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='068ab2c0-eb0f-418e-bf5c-b80f8416ab91',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1422809681',owner_user_name='tempest-TestMinimumBasicScenario-1422809681-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:24:47Z,user_data=None,user_id='a40e5176e01443a085c01fc677cc8ca9',uuid=12c7098d-b640-43ae-9e9c-a2cd6edf3eaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:27:29 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converting VIF {"id": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "address": "fa:16:3e:76:18:63", "network": {"id": "3e2e0d8a-8480-4027-b17f-0752b1245015", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1341790391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c212a5254bcc4de290ec4bfbf8fbbd4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9e7de-13", "ovs_interfaceid": "69b9e7de-13a8-4339-b2df-8547ea668cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:27:29 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:18:63,bridge_name='br-int',has_traffic_filtering=True,id=69b9e7de-13a8-4339-b2df-8547ea668cd7,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9e7de-13') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:27:29 user nova-compute[72447]: DEBUG os_vif [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:18:63,bridge_name='br-int',has_traffic_filtering=True,id=69b9e7de-13a8-4339-b2df-8547ea668cd7,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9e7de-13') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:27:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69b9e7de-13, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:29 user nova-compute[72447]: INFO os_vif [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:18:63,bridge_name='br-int',has_traffic_filtering=True,id=69b9e7de-13a8-4339-b2df-8547ea668cd7,network=Network(3e2e0d8a-8480-4027-b17f-0752b1245015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9e7de-13')
Jul 31 12:27:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Deleting instance files /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa_del
Jul 31 12:27:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Deletion of /opt/stack/data/nova/instances/12c7098d-b640-43ae-9e9c-a2cd6edf3eaa_del complete
Jul 31 12:27:29 user nova-compute[72447]: INFO nova.compute.manager [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 31 12:27:29 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:27:29 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:27:29 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-11e3ae54-d9c9-4419-856b-f5913ea396a7 req-40b22b2c-e102-435c-acde-8b18b78e7e98 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-vif-unplugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-11e3ae54-d9c9-4419-856b-f5913ea396a7 req-40b22b2c-e102-435c-acde-8b18b78e7e98 service nova] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-11e3ae54-d9c9-4419-856b-f5913ea396a7 req-40b22b2c-e102-435c-acde-8b18b78e7e98 service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-11e3ae54-d9c9-4419-856b-f5913ea396a7 req-40b22b2c-e102-435c-acde-8b18b78e7e98 service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-11e3ae54-d9c9-4419-856b-f5913ea396a7 req-40b22b2c-e102-435c-acde-8b18b78e7e98 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] No waiting events found dispatching network-vif-unplugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-11e3ae54-d9c9-4419-856b-f5913ea396a7 req-40b22b2c-e102-435c-acde-8b18b78e7e98 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-vif-unplugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-11e3ae54-d9c9-4419-856b-f5913ea396a7 req-40b22b2c-e102-435c-acde-8b18b78e7e98 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-11e3ae54-d9c9-4419-856b-f5913ea396a7 req-40b22b2c-e102-435c-acde-8b18b78e7e98 service nova] Acquiring lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-11e3ae54-d9c9-4419-856b-f5913ea396a7 req-40b22b2c-e102-435c-acde-8b18b78e7e98 service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-11e3ae54-d9c9-4419-856b-f5913ea396a7 req-40b22b2c-e102-435c-acde-8b18b78e7e98 service nova] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-11e3ae54-d9c9-4419-856b-f5913ea396a7 req-40b22b2c-e102-435c-acde-8b18b78e7e98 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] No waiting events found dispatching network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:30 user nova-compute[72447]: WARNING nova.compute.manager [req-11e3ae54-d9c9-4419-856b-f5913ea396a7 req-40b22b2c-e102-435c-acde-8b18b78e7e98 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received unexpected event network-vif-plugged-69b9e7de-13a8-4339-b2df-8547ea668cd7 for instance with vm_state active and task_state deleting.
Jul 31 12:27:30 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-9095b01a-649c-4c74-9189-40bfb78a31b2 req-a93640be-efdd-4322-8e2d-18f0ab9fd6e3 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Received event network-vif-deleted-69b9e7de-13a8-4339-b2df-8547ea668cd7 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:30 user nova-compute[72447]: INFO nova.compute.manager [req-9095b01a-649c-4c74-9189-40bfb78a31b2 req-a93640be-efdd-4322-8e2d-18f0ab9fd6e3 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Neutron deleted interface 69b9e7de-13a8-4339-b2df-8547ea668cd7; detaching it from the instance and deleting it from the info cache
Jul 31 12:27:30 user nova-compute[72447]: DEBUG nova.network.neutron [req-9095b01a-649c-4c74-9189-40bfb78a31b2 req-a93640be-efdd-4322-8e2d-18f0ab9fd6e3 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:27:30 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Took 0.56 seconds to deallocate network for instance.
Jul 31 12:27:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-9095b01a-649c-4c74-9189-40bfb78a31b2 req-a93640be-efdd-4322-8e2d-18f0ab9fd6e3 service nova] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Detach interface failed, port_id=69b9e7de-13a8-4339-b2df-8547ea668cd7, reason: Instance 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:27:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:30 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Deleted allocations for instance 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa
Jul 31 12:27:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-a44883ea-34a6-407a-8605-a6aff8a09343 tempest-TestMinimumBasicScenario-1422809681 tempest-TestMinimumBasicScenario-1422809681-project-member] Lock "12c7098d-b640-43ae-9e9c-a2cd6edf3eaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.158s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG os_brick.utils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11a6934-7f27-4e56-a368-5e38cd020646]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a40cd9-bba5-4d36-b331-7d04d2165244]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767c13c-11f0-4146-83a9-56799f06ef3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7701d2-5334-4fc1-af23-99581272d1c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:27:32 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:27:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4550b8fc-d389-4b08-aceb-59485d47a275]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG os_brick.utils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:27:32 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Updating existing volume attachment record: 760b2421-91a0-4245-b545-70810fcbdb23 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:27:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "b71826ea-5fc4-4405-80b2-12e681ebb88a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:37 user nova-compute[72447]: DEBUG nova.objects.instance [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lazy-loading 'flavor' on Instance uuid b71826ea-5fc4-4405-80b2-12e681ebb88a {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:27:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "b71826ea-5fc4-4405-80b2-12e681ebb88a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:37 user nova-compute[72447]: INFO nova.compute.manager [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Attaching volume a2d51982-d022-4737-bb48-34ba86f005e0 to /dev/vdb
Jul 31 12:27:38 user nova-compute[72447]: DEBUG os_brick.utils [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee207e76-3e56-459c-a64a-bfeabc170ace]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0ffe5b-92e4-451d-8936-ae397300a8a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87819aa-3bcc-4d1f-8df4-90d72e0975b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c426d5-0d07-482b-9fb4-c6e434363d53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:27:38 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:27:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bd36e3-e13e-4a41-a967-a26244cd3c2f]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG os_brick.utils [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:27:38 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Updating existing volume attachment record: 56d1f410-d80d-4aa1-b85b-476019f55488 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:27:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:44 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806449.5695992, 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:27:44 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] VM Stopped (Lifecycle Event)
Jul 31 12:27:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-394d56c7-8eb0-45c5-821d-a8092a765a74 None None] [instance: 12c7098d-b640-43ae-9e9c-a2cd6edf3eaa] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOWYBget', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:27:45 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:27:45 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:27:45 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c762b421-2d11-46c7-a78b-56ff021c06eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:27:45 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee16a10-8f1b-4966-b962-bd4ad3172f51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0] added
Jul 31 12:27:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[19684f00-f2d6-4ff3-97e8-e5df98f3dca0]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1058f1c-403e-4a38-b628-323e339f17d5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NOWYBget {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NOWYBget" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f585fe6d-4898-4702-bd9a-d3a8dc7e034d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NOWYBget'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caed586-c59e-4f3f-aab3-b49d26deadaa]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee908a55-6540-4f8e-88aa-8767da295110]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:45 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:27:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:45 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:27:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b53dc7d-60f8-4f51-8ccc-5134fd25d779]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0, portal: 172.16.0.220,3260]
Jul 31 12:27:45 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0, portal: 172.16.0.220,3260] successful.
Jul 31 12:27:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64152c6-bffe-4f95-9007-3b012b0a9417]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e3b73b-50be-4766-b561-daf930addec7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:45 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:27:45 user nova-compute[72447]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 (non-flash)
Jul 31 12:27:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:45 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:27:45 user nova-compute[72447]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 (non-flash)
Jul 31 12:27:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[828ff1d5-8b49-41eb-ae9b-1994dc63892e]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:27:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOWYBget', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:27:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:27:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23965636339366134', 'path': '/dev/sdd'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:27:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965636339366134', 'path': '/dev/sdd'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:27:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lazy-loading 'flavor' on Instance uuid b71826ea-5fc4-4405-80b2-12e681ebb88a {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:27:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:27:46 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:27:46 user nova-compute[72447]:   <source dev="/dev/sdd"/>
Jul 31 12:27:46 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:27:46 user nova-compute[72447]:   <serial>a2d51982-d022-4737-bb48-34ba86f005e0</serial>
Jul 31 12:27:46 user nova-compute[72447]: </disk>
Jul 31 12:27:46 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:27:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:27:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:27:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] No VIF found with MAC fa:16:3e:e7:7a:5c, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:27:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-38c31860-a04e-4973-b4d6-fc219173783b tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.429s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "b71826ea-5fc4-4405-80b2-12e681ebb88a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:47 user nova-compute[72447]: INFO nova.compute.manager [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Terminating instance
Jul 31 12:27:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:27:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-4a8e4f95-594d-4237-be3d-6554e09e060d req-ff8e0224-1284-4e75-841c-13a241d26ce2 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Received event network-vif-unplugged-4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4a8e4f95-594d-4237-be3d-6554e09e060d req-ff8e0224-1284-4e75-841c-13a241d26ce2 service nova] Acquiring lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4a8e4f95-594d-4237-be3d-6554e09e060d req-ff8e0224-1284-4e75-841c-13a241d26ce2 service nova] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4a8e4f95-594d-4237-be3d-6554e09e060d req-ff8e0224-1284-4e75-841c-13a241d26ce2 service nova] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-4a8e4f95-594d-4237-be3d-6554e09e060d req-ff8e0224-1284-4e75-841c-13a241d26ce2 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] No waiting events found dispatching network-vif-unplugged-4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-4a8e4f95-594d-4237-be3d-6554e09e060d req-ff8e0224-1284-4e75-841c-13a241d26ce2 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Received event network-vif-unplugged-4ada2961-0a0e-4d37-b977-c4838cb960fe for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:27:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Instance destroyed successfully.
Jul 31 12:27:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lazy-loading 'resources' on Instance uuid b71826ea-5fc4-4405-80b2-12e681ebb88a {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2123936526',display_name='tempest-DeleteServersTestJSON-server-2123936526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2123936526',id=33,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:25:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09317a99770b41abaa8ba73252e034e2',ramdisk_id='',reservation_id='r-x7k4s0i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1035655362',owner_user_name='tempest-DeleteServersTestJSON-1035655362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:25:52Z,user_data=None,user_id='1f1a34a7ac5a4a53a1051bfa2e61a713',uuid=b71826ea-5fc4-4405-80b2-12e681ebb88a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "address": "fa:16:3e:e7:7a:5c", "network": {"id": "d955ee3f-be94-4165-92f0-5fd5893f50aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-955978129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09317a99770b41abaa8ba73252e034e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ada2961-0a", "ovs_interfaceid": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Converting VIF {"id": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "address": "fa:16:3e:e7:7a:5c", "network": {"id": "d955ee3f-be94-4165-92f0-5fd5893f50aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-955978129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09317a99770b41abaa8ba73252e034e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ada2961-0a", "ovs_interfaceid": "4ada2961-0a0e-4d37-b977-c4838cb960fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7a:5c,bridge_name='br-int',has_traffic_filtering=True,id=4ada2961-0a0e-4d37-b977-c4838cb960fe,network=Network(d955ee3f-be94-4165-92f0-5fd5893f50aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ada2961-0a') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_vif [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7a:5c,bridge_name='br-int',has_traffic_filtering=True,id=4ada2961-0a0e-4d37-b977-c4838cb960fe,network=Network(d955ee3f-be94-4165-92f0-5fd5893f50aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ada2961-0a') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ada2961-0a, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:48 user nova-compute[72447]: INFO os_vif [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7a:5c,bridge_name='br-int',has_traffic_filtering=True,id=4ada2961-0a0e-4d37-b977-c4838cb960fe,network=Network(d955ee3f-be94-4165-92f0-5fd5893f50aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ada2961-0a')
Jul 31 12:27:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOWYBget', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:27:48 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[25df957d-3d85-4279-b722-d2119f6bd516]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c63405-fa36-473b-80a0-85b94db0d1b6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:48 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:27:48 user nova-compute[72447]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 (non-flash)
Jul 31 12:27:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:48 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:27:48 user nova-compute[72447]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 (non-flash)
Jul 31 12:27:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0670299750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0'): ({'sdd'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Removing single pathed devices sdd {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc4e160-1468-43a9-8cdd-acee2d0dd88a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a6bdc3-f570-4cc6-be15-f55dfd92da3c]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Flushing IO for device /dev/sdd {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a037dca-7000-4797-8ebe-cb66d80b9413]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[23569610-bd37-4f1f-9add-ad267e142240]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[680c98c3-e246-4101-b57b-40bea554164b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdc70a2-f2da-4728-b51f-68f4e369c412]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0, portal: 172.16.0.220,3260]
Jul 31 12:27:48 user nova-compute[72447]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0, portal: 172.16.0.220,3260] successful.
Jul 31 12:27:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d51982-d022-4737-bb48-34ba86f005e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df12933-f54e-4f06-bb97-e34e900c7b9c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] <== disconnect_volume: return (285ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:27:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:27:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Deleting instance files /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a_del
Jul 31 12:27:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Deletion of /opt/stack/data/nova/instances/b71826ea-5fc4-4405-80b2-12e681ebb88a_del complete
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:27:49 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Creating image(s)
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Ensure instance console log exists: /opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Start _get_guest_xml network_info=[{"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '760b2421-91a0-4245-b545-70810fcbdb23', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRHOtSTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0', 'attached_at': '', 'detached_at': '', 'volume_id': '95a5aa38-dc89-4b03-ac50-f5fba0e7b7df', 'serial': '95a5aa38-dc89-4b03-ac50-f5fba0e7b7df'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:27:49 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:27:49 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRHOtSTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:27:49 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:27:49 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:27:49 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:49 user nova-compute[72447]: INFO nova.compute.manager [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Took 1.20 seconds to destroy the instance on the hypervisor.
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a1a8b7-d459-4e23-8711-cf6cd72a6af7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:27:49 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[18889d61-3d7f-4615-864e-e86429a7ad0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df] added
Jul 31 12:27:49 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[59427d95-83d3-4829-9dc5-6e445970c880]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64e85f6-e4e8-4353-b9e6-2a210f9d24c4]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRHOtSTc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRHOtSTc" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8748d6f6-07af-48e9-b105-c717fc6ef26a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZRHOtSTc'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c982e1f0-d258-4d2f-873e-d4d0de43b375]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2e7bb4-bc2e-41c1-a522-3e872af652da]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:49 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:27:49 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:49 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:27:49 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0febc1-336d-45d4-a448-667f94491417]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df, portal: 172.16.0.220,3260]
Jul 31 12:27:49 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df, portal: 172.16.0.220,3260] successful.
Jul 31 12:27:49 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[313d37fa-48be-41a0-b41e-4a63da296dbc]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc0a6a0-41d3-4d52-9a7a-a17c7ac18d23]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:49 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:27:49 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:27:49 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:27:49 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:27:49 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:27:49 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66e9617-f06d-4d94-ba8c-c7abe6cec1ec]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-4327f0db-f355-499b-b913-86725578d9e5 req-c54a879a-3147-4eb0-b391-f6e64dec9e21 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Received event network-vif-deleted-4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:49 user nova-compute[72447]: INFO nova.compute.manager [req-4327f0db-f355-499b-b913-86725578d9e5 req-c54a879a-3147-4eb0-b391-f6e64dec9e21 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Neutron deleted interface 4ada2961-0a0e-4d37-b977-c4838cb960fe; detaching it from the instance and deleting it from the info cache
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.network.neutron [req-4327f0db-f355-499b-b913-86725578d9e5 req-c54a879a-3147-4eb0-b391-f6e64dec9e21 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:27:49 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Took 0.55 seconds to deallocate network for instance.
Jul 31 12:27:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-4327f0db-f355-499b-b913-86725578d9e5 req-c54a879a-3147-4eb0-b391-f6e64dec9e21 service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Detach interface failed, port_id=4ada2961-0a0e-4d37-b977-c4838cb960fe, reason: Instance b71826ea-5fc4-4405-80b2-12e681ebb88a could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-5279354f-d7bb-42ad-9092-ca1a74946999 req-fbe14404-c2d6-40ad-994c-381ffe772abd service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Received event network-vif-plugged-4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5279354f-d7bb-42ad-9092-ca1a74946999 req-fbe14404-c2d6-40ad-994c-381ffe772abd service nova] Acquiring lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5279354f-d7bb-42ad-9092-ca1a74946999 req-fbe14404-c2d6-40ad-994c-381ffe772abd service nova] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5279354f-d7bb-42ad-9092-ca1a74946999 req-fbe14404-c2d6-40ad-994c-381ffe772abd service nova] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-5279354f-d7bb-42ad-9092-ca1a74946999 req-fbe14404-c2d6-40ad-994c-381ffe772abd service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] No waiting events found dispatching network-vif-plugged-4ada2961-0a0e-4d37-b977-c4838cb960fe {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:50 user nova-compute[72447]: WARNING nova.compute.manager [req-5279354f-d7bb-42ad-9092-ca1a74946999 req-fbe14404-c2d6-40ad-994c-381ffe772abd service nova] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Received unexpected event network-vif-plugged-4ada2961-0a0e-4d37-b977-c4838cb960fe for instance with vm_state active and task_state deleting.
Jul 31 12:27:50 user nova-compute[72447]: INFO nova.compute.manager [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Took 0.74 seconds to detach 1 volumes for instance.
Jul 31 12:27:50 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRHOtSTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23130643234303034', 'path': '/dev/sdd'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130643234303034', 'path': '/dev/sdd'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1891158354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1891158354',id=37,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-3c0dkf4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:27:22Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:9c:86,bridge_name='br-int',has_traffic_filtering=True,id=82f2076d-509b-45d4-9ef3-cfc546e01a85,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f2076d-50') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.objects.instance [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:27:50 user nova-compute[72447]:   <uuid>6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0</uuid>
Jul 31 12:27:50 user nova-compute[72447]:   <name>instance-00000025</name>
Jul 31 12:27:50 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:27:50 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:27:50 user nova-compute[72447]:   <metadata>
Jul 31 12:27:50 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:27:50 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:27:50 user nova-compute[72447]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1891158354</nova:name>
Jul 31 12:27:50 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:27:49</nova:creationTime>
Jul 31 12:27:50 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:27:50 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:27:50 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:27:50 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:27:50 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:27:50 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:27:50 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:27:50 user nova-compute[72447]:       <nova:owner>
Jul 31 12:27:50 user nova-compute[72447]:         <nova:user uuid="33268392189342ecbca53c9ad959245e">tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member</nova:user>
Jul 31 12:27:50 user nova-compute[72447]:         <nova:project uuid="a055fae579aa4858867824625e8bd18d">tempest-ServerBootFromVolumeStableRescueTest-1637857313</nova:project>
Jul 31 12:27:50 user nova-compute[72447]:       </nova:owner>
Jul 31 12:27:50 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:27:50 user nova-compute[72447]:       <nova:ports>
Jul 31 12:27:50 user nova-compute[72447]:         <nova:port uuid="82f2076d-509b-45d4-9ef3-cfc546e01a85">
Jul 31 12:27:50 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 12:27:50 user nova-compute[72447]:         </nova:port>
Jul 31 12:27:50 user nova-compute[72447]:       </nova:ports>
Jul 31 12:27:50 user nova-compute[72447]:     </nova:instance>
Jul 31 12:27:50 user nova-compute[72447]:   </metadata>
Jul 31 12:27:50 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:27:50 user nova-compute[72447]:     <system>
Jul 31 12:27:50 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:27:50 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:27:50 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:27:50 user nova-compute[72447]:       <entry name="serial">6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0</entry>
Jul 31 12:27:50 user nova-compute[72447]:       <entry name="uuid">6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0</entry>
Jul 31 12:27:50 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:27:50 user nova-compute[72447]:     </system>
Jul 31 12:27:50 user nova-compute[72447]:   </sysinfo>
Jul 31 12:27:50 user nova-compute[72447]:   <os>
Jul 31 12:27:50 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:27:50 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:27:50 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:27:50 user nova-compute[72447]:   </os>
Jul 31 12:27:50 user nova-compute[72447]:   <features>
Jul 31 12:27:50 user nova-compute[72447]:     <acpi/>
Jul 31 12:27:50 user nova-compute[72447]:     <apic/>
Jul 31 12:27:50 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:27:50 user nova-compute[72447]:   </features>
Jul 31 12:27:50 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:27:50 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:27:50 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:27:50 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:27:50 user nova-compute[72447]:   </clock>
Jul 31 12:27:50 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:27:50 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:27:50 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:27:50 user nova-compute[72447]:   </cpu>
Jul 31 12:27:50 user nova-compute[72447]:   <devices>
Jul 31 12:27:50 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:27:50 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:27:50 user nova-compute[72447]:       <source dev="/dev/sdd"/>
Jul 31 12:27:50 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:27:50 user nova-compute[72447]:       <serial>95a5aa38-dc89-4b03-ac50-f5fba0e7b7df</serial>
Jul 31 12:27:50 user nova-compute[72447]:     </disk>
Jul 31 12:27:50 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:27:50 user nova-compute[72447]:       <mac address="fa:16:3e:23:9c:86"/>
Jul 31 12:27:50 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:27:50 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:27:50 user nova-compute[72447]:       <target dev="tap82f2076d-50"/>
Jul 31 12:27:50 user nova-compute[72447]:     </interface>
Jul 31 12:27:50 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:27:50 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/console.log" append="off"/>
Jul 31 12:27:50 user nova-compute[72447]:     </serial>
Jul 31 12:27:50 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:27:50 user nova-compute[72447]:     <video>
Jul 31 12:27:50 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:27:50 user nova-compute[72447]:     </video>
Jul 31 12:27:50 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:27:50 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:27:50 user nova-compute[72447]:     </rng>
Jul 31 12:27:50 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:27:50 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:27:50 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:27:50 user nova-compute[72447]:     </memballoon>
Jul 31 12:27:50 user nova-compute[72447]:   </devices>
Jul 31 12:27:50 user nova-compute[72447]: </domain>
Jul 31 12:27:50 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1891158354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1891158354',id=37,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-3c0dkf4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:27:22Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:9c:86,bridge_name='br-int',has_traffic_filtering=True,id=82f2076d-509b-45d4-9ef3-cfc546e01a85,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f2076d-50') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG os_vif [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:9c:86,bridge_name='br-int',has_traffic_filtering=True,id=82f2076d-509b-45d4-9ef3-cfc546e01a85,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f2076d-50') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82f2076d-50, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82f2076d-50, col_values=(('external_ids', {'iface-id': '82f2076d-509b-45d4-9ef3-cfc546e01a85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:9c:86', 'vm-uuid': '6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:50 user nova-compute[72447]: INFO os_vif [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:9c:86,bridge_name='br-int',has_traffic_filtering=True,id=82f2076d-509b-45d4-9ef3-cfc546e01a85,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f2076d-50')
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No VIF found with MAC fa:16:3e:23:9c:86, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:27:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:50 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Deleted allocations for instance b71826ea-5fc4-4405-80b2-12e681ebb88a
Jul 31 12:27:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6cf59751-b706-4a50-836b-268a235a97ed tempest-DeleteServersTestJSON-1035655362 tempest-DeleteServersTestJSON-1035655362-project-member] Lock "b71826ea-5fc4-4405-80b2-12e681ebb88a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.145s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-d5db043b-2d56-40ff-b9ee-77feb65c161d req-0ac507de-c548-4d0f-bb35-0dba332d185f service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d5db043b-2d56-40ff-b9ee-77feb65c161d req-0ac507de-c548-4d0f-bb35-0dba332d185f service nova] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d5db043b-2d56-40ff-b9ee-77feb65c161d req-0ac507de-c548-4d0f-bb35-0dba332d185f service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d5db043b-2d56-40ff-b9ee-77feb65c161d req-0ac507de-c548-4d0f-bb35-0dba332d185f service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-d5db043b-2d56-40ff-b9ee-77feb65c161d req-0ac507de-c548-4d0f-bb35-0dba332d185f service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] No waiting events found dispatching network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:52 user nova-compute[72447]: WARNING nova.compute.manager [req-d5db043b-2d56-40ff-b9ee-77feb65c161d req-0ac507de-c548-4d0f-bb35-0dba332d185f service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received unexpected event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 for instance with vm_state building and task_state spawning.
Jul 31 12:27:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:53 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806473.9734833, 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:27:53 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] VM Resumed (Lifecycle Event)
Jul 31 12:27:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:27:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:27:53 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Instance spawned successfully.
Jul 31 12:27:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:27:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:27:54 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806473.974825, 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:27:54 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] VM Started (Lifecycle Event)
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:27:54 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:27:54 user nova-compute[72447]: INFO nova.compute.manager [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Took 5.08 seconds to spawn the instance on the hypervisor.
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-a3be6fcf-5cb9-46f6-96d2-f2061ed7aa62 req-9fbc67ac-13a9-471a-b420-c5f7af3fe942 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a3be6fcf-5cb9-46f6-96d2-f2061ed7aa62 req-9fbc67ac-13a9-471a-b420-c5f7af3fe942 service nova] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a3be6fcf-5cb9-46f6-96d2-f2061ed7aa62 req-9fbc67ac-13a9-471a-b420-c5f7af3fe942 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a3be6fcf-5cb9-46f6-96d2-f2061ed7aa62 req-9fbc67ac-13a9-471a-b420-c5f7af3fe942 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-a3be6fcf-5cb9-46f6-96d2-f2061ed7aa62 req-9fbc67ac-13a9-471a-b420-c5f7af3fe942 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] No waiting events found dispatching network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:27:54 user nova-compute[72447]: WARNING nova.compute.manager [req-a3be6fcf-5cb9-46f6-96d2-f2061ed7aa62 req-9fbc67ac-13a9-471a-b420-c5f7af3fe942 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received unexpected event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 for instance with vm_state building and task_state spawning.
Jul 31 12:27:54 user nova-compute[72447]: INFO nova.compute.manager [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Took 33.06 seconds to build instance.
Jul 31 12:27:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-50a193bb-e91d-4adb-b8ee-2a447c573d22 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.170s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:27:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:27:58 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:27:58 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:27:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:27:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:27:58 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:27:59 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Updating instance_info_cache with network_info: [{"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:27:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:27:59 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:28:00 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:28:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:01 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:28:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:28:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:28:02 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:28:03 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:28:03 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806468.6464953, b71826ea-5fc4-4405-80b2-12e681ebb88a => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:28:03 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] VM Stopped (Lifecycle Event)
Jul 31 12:28:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9ebbfaf1-a551-488f-812c-85ccabdd521a None None] [instance: b71826ea-5fc4-4405-80b2-12e681ebb88a] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:04 user nova-compute[72447]: INFO nova.compute.manager [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Terminating instance
Jul 31 12:28:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-5e6a9f5d-4af3-451b-a914-940f6417d4d2 req-c41fe42e-abda-46e7-a54b-2bc5c1941a1b service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-unplugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5e6a9f5d-4af3-451b-a914-940f6417d4d2 req-c41fe42e-abda-46e7-a54b-2bc5c1941a1b service nova] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5e6a9f5d-4af3-451b-a914-940f6417d4d2 req-c41fe42e-abda-46e7-a54b-2bc5c1941a1b service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5e6a9f5d-4af3-451b-a914-940f6417d4d2 req-c41fe42e-abda-46e7-a54b-2bc5c1941a1b service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-5e6a9f5d-4af3-451b-a914-940f6417d4d2 req-c41fe42e-abda-46e7-a54b-2bc5c1941a1b service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] No waiting events found dispatching network-vif-unplugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-5e6a9f5d-4af3-451b-a914-940f6417d4d2 req-c41fe42e-abda-46e7-a54b-2bc5c1941a1b service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-unplugged-845d0677-fdf6-4de9-abc7-243080eeae50 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:28:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:05 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Instance destroyed successfully.
Jul 31 12:28:05 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lazy-loading 'resources' on Instance uuid 981b694a-bf63-4f4b-95c5-bc17aa72b87b {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2031996339',display_name='tempest-ServerRescueNegativeTestJSON-server-2031996339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2031996339',id=1,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:15:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9576e1abb5b1475da061ca824d7c3788',ramdisk_id='',reservation_id='r-dmkw01xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2103641702',owner_user_name='tempest-ServerRescueNegativeTestJSON-2103641702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:17:37Z,user_data=None,user_id='cbcdd571b45b4450a8b27b834a05a2b6',uuid=981b694a-bf63-4f4b-95c5-bc17aa72b87b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converting VIF {"id": "845d0677-fdf6-4de9-abc7-243080eeae50", "address": "fa:16:3e:cf:66:ee", "network": {"id": "1bf19c82-b014-451d-8eb5-23c57e1fe85d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1448016813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9576e1abb5b1475da061ca824d7c3788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845d0677-fd", "ovs_interfaceid": "845d0677-fdf6-4de9-abc7-243080eeae50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:66:ee,bridge_name='br-int',has_traffic_filtering=True,id=845d0677-fdf6-4de9-abc7-243080eeae50,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845d0677-fd') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG os_vif [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:66:ee,bridge_name='br-int',has_traffic_filtering=True,id=845d0677-fdf6-4de9-abc7-243080eeae50,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845d0677-fd') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap845d0677-fd, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:28:05 user nova-compute[72447]: INFO os_vif [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:66:ee,bridge_name='br-int',has_traffic_filtering=True,id=845d0677-fdf6-4de9-abc7-243080eeae50,network=Network(1bf19c82-b014-451d-8eb5-23c57e1fe85d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845d0677-fd')
Jul 31 12:28:05 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Deleting instance files /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b_del
Jul 31 12:28:05 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Deletion of /opt/stack/data/nova/instances/981b694a-bf63-4f4b-95c5-bc17aa72b87b_del complete
Jul 31 12:28:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:05 user nova-compute[72447]: INFO nova.compute.manager [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:28:05 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Took 0.50 seconds to deallocate network for instance.
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-73cabd15-b594-494f-83ee-7cd28709d8a4 req-fe235670-9c2c-4226-977f-de4a79690ba5 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-deleted-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:05 user nova-compute[72447]: INFO nova.compute.manager [req-73cabd15-b594-494f-83ee-7cd28709d8a4 req-fe235670-9c2c-4226-977f-de4a79690ba5 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Neutron deleted interface 845d0677-fdf6-4de9-abc7-243080eeae50; detaching it from the instance and deleting it from the info cache
Jul 31 12:28:05 user nova-compute[72447]: DEBUG nova.network.neutron [req-73cabd15-b594-494f-83ee-7cd28709d8a4 req-fe235670-9c2c-4226-977f-de4a79690ba5 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-73cabd15-b594-494f-83ee-7cd28709d8a4 req-fe235670-9c2c-4226-977f-de4a79690ba5 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Detach interface failed, port_id=845d0677-fdf6-4de9-abc7-243080eeae50, reason: Instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:06 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Deleted allocations for instance 981b694a-bf63-4f4b-95c5-bc17aa72b87b
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fc808842-a8cd-49bb-bdf2-65e9f89a03da tempest-ServerRescueNegativeTestJSON-2103641702 tempest-ServerRescueNegativeTestJSON-2103641702-project-member] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.162s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-3940977e-fab9-432f-929e-5bff5225480a req-ec603ad6-795f-4b5b-a70a-866a2c932224 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3940977e-fab9-432f-929e-5bff5225480a req-ec603ad6-795f-4b5b-a70a-866a2c932224 service nova] Acquiring lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3940977e-fab9-432f-929e-5bff5225480a req-ec603ad6-795f-4b5b-a70a-866a2c932224 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3940977e-fab9-432f-929e-5bff5225480a req-ec603ad6-795f-4b5b-a70a-866a2c932224 service nova] Lock "981b694a-bf63-4f4b-95c5-bc17aa72b87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-3940977e-fab9-432f-929e-5bff5225480a req-ec603ad6-795f-4b5b-a70a-866a2c932224 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] No waiting events found dispatching network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:28:06 user nova-compute[72447]: WARNING nova.compute.manager [req-3940977e-fab9-432f-929e-5bff5225480a req-ec603ad6-795f-4b5b-a70a-866a2c932224 service nova] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Received unexpected event network-vif-plugged-845d0677-fdf6-4de9-abc7-243080eeae50 for instance with vm_state deleted and task_state None.
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:28:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:28:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:08 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:28:08 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7163MB free_disk=25.045211791992188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Applying migration context for instance 2a481721-232b-4a4d-83ad-cfbac144bb5e as it has an incoming, in-progress migration 80bd52de-365a-4151-9be1-e6372710ef40. Migration status is finished {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 12:28:08 user nova-compute[72447]: INFO nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updating resource usage from migration 80bd52de-365a-4151-9be1-e6372710ef40
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance b5fe9835-8278-449e-9069-18421cb088dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance f3f1534b-16c0-4dee-b78c-d53713113a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance c8aaf2f0-737d-4523-9e7a-12237bc41a74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Migration 80bd52de-365a-4151-9be1-e6372710ef40 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2a481721-232b-4a4d-83ad-cfbac144bb5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance cf664b3e-d48f-45d1-b47e-53e81c769054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:28:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 51e36718-ed91-4dc5-82db-1f429df14d2f {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 0dbd2353-0521-4e92-8722-6151bfb40924 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid b5fe9835-8278-449e-9069-18421cb088dd {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid f3f1534b-16c0-4dee-b78c-d53713113a64 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 2a481721-232b-4a4d-83ad-cfbac144bb5e {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid c8aaf2f0-737d-4523-9e7a-12237bc41a74 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid cf664b3e-d48f-45d1-b47e-53e81c769054 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "51e36718-ed91-4dc5-82db-1f429df14d2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "0dbd2353-0521-4e92-8722-6151bfb40924" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "b5fe9835-8278-449e-9069-18421cb088dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "b5fe9835-8278-449e-9069-18421cb088dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "f3f1534b-16c0-4dee-b78c-d53713113a64" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "cf664b3e-d48f-45d1-b47e-53e81c769054" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "0dbd2353-0521-4e92-8722-6151bfb40924" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "b5fe9835-8278-449e-9069-18421cb088dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:12 user nova-compute[72447]: INFO nova.compute.manager [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Terminating instance
Jul 31 12:28:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-e6a5483d-77d9-43de-8933-069742eedb4a req-d49e7f5c-35e5-415c-8f72-0ea71ccc2a71 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Received event network-vif-unplugged-c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e6a5483d-77d9-43de-8933-069742eedb4a req-d49e7f5c-35e5-415c-8f72-0ea71ccc2a71 service nova] Acquiring lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e6a5483d-77d9-43de-8933-069742eedb4a req-d49e7f5c-35e5-415c-8f72-0ea71ccc2a71 service nova] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e6a5483d-77d9-43de-8933-069742eedb4a req-d49e7f5c-35e5-415c-8f72-0ea71ccc2a71 service nova] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-e6a5483d-77d9-43de-8933-069742eedb4a req-d49e7f5c-35e5-415c-8f72-0ea71ccc2a71 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] No waiting events found dispatching network-vif-unplugged-c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:28:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-e6a5483d-77d9-43de-8933-069742eedb4a req-d49e7f5c-35e5-415c-8f72-0ea71ccc2a71 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Received event network-vif-unplugged-c606bcee-7fcd-4b69-93c1-772af333b4f2 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:28:13 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Instance destroyed successfully.
Jul 31 12:28:13 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lazy-loading 'resources' on Instance uuid c8aaf2f0-737d-4523-9e7a-12237bc41a74 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:28:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:26:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1574384154',display_name='tempest-VolumesActionsTest-instance-1574384154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1574384154',id=34,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:26:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49e21ac0a7354b85bcbe334edfc00fd5',ramdisk_id='',reservation_id='r-p02a0o8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-489730423',owner_user_name='tempest-VolumesActionsTest-489730423-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:26:28Z,user_data=None,user_id='1c7a178f684246608fded95196469c0f',uuid=c8aaf2f0-737d-4523-9e7a-12237bc41a74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "address": "fa:16:3e:60:00:91", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606bcee-7f", "ovs_interfaceid": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:28:13 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Converting VIF {"id": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "address": "fa:16:3e:60:00:91", "network": {"id": "67271d52-4884-40f5-ac3d-f8521032ca78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883035682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49e21ac0a7354b85bcbe334edfc00fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606bcee-7f", "ovs_interfaceid": "c606bcee-7fcd-4b69-93c1-772af333b4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:28:13 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:00:91,bridge_name='br-int',has_traffic_filtering=True,id=c606bcee-7fcd-4b69-93c1-772af333b4f2,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606bcee-7f') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:28:13 user nova-compute[72447]: DEBUG os_vif [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:00:91,bridge_name='br-int',has_traffic_filtering=True,id=c606bcee-7fcd-4b69-93c1-772af333b4f2,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606bcee-7f') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:28:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc606bcee-7f, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:28:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:28:13 user nova-compute[72447]: INFO os_vif [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:00:91,bridge_name='br-int',has_traffic_filtering=True,id=c606bcee-7fcd-4b69-93c1-772af333b4f2,network=Network(67271d52-4884-40f5-ac3d-f8521032ca78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606bcee-7f')
Jul 31 12:28:13 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Deleting instance files /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74_del
Jul 31 12:28:13 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Deletion of /opt/stack/data/nova/instances/c8aaf2f0-737d-4523-9e7a-12237bc41a74_del complete
Jul 31 12:28:13 user nova-compute[72447]: INFO nova.compute.manager [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 31 12:28:13 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:28:13 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:28:13 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:28:13 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:28:13 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Took 0.47 seconds to deallocate network for instance.
Jul 31 12:28:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:14 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:28:14 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:28:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:14 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Deleted allocations for instance c8aaf2f0-737d-4523-9e7a-12237bc41a74
Jul 31 12:28:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6728edc6-e2e4-4e6c-9497-d9932df35ac9 tempest-VolumesActionsTest-489730423 tempest-VolumesActionsTest-489730423-project-member] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.920s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-cd546ce7-3872-4036-90ea-8c7cd83d8c7e req-e3b79a3d-ed52-4dec-b528-e22ba6cf34e9 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Received event network-vif-plugged-c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cd546ce7-3872-4036-90ea-8c7cd83d8c7e req-e3b79a3d-ed52-4dec-b528-e22ba6cf34e9 service nova] Acquiring lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cd546ce7-3872-4036-90ea-8c7cd83d8c7e req-e3b79a3d-ed52-4dec-b528-e22ba6cf34e9 service nova] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cd546ce7-3872-4036-90ea-8c7cd83d8c7e req-e3b79a3d-ed52-4dec-b528-e22ba6cf34e9 service nova] Lock "c8aaf2f0-737d-4523-9e7a-12237bc41a74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-cd546ce7-3872-4036-90ea-8c7cd83d8c7e req-e3b79a3d-ed52-4dec-b528-e22ba6cf34e9 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] No waiting events found dispatching network-vif-plugged-c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:28:14 user nova-compute[72447]: WARNING nova.compute.manager [req-cd546ce7-3872-4036-90ea-8c7cd83d8c7e req-e3b79a3d-ed52-4dec-b528-e22ba6cf34e9 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Received unexpected event network-vif-plugged-c606bcee-7fcd-4b69-93c1-772af333b4f2 for instance with vm_state deleted and task_state None.
Jul 31 12:28:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-cd546ce7-3872-4036-90ea-8c7cd83d8c7e req-e3b79a3d-ed52-4dec-b528-e22ba6cf34e9 service nova] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Received event network-vif-deleted-c606bcee-7fcd-4b69-93c1-772af333b4f2 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "b5fe9835-8278-449e-9069-18421cb088dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "b5fe9835-8278-449e-9069-18421cb088dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "b5fe9835-8278-449e-9069-18421cb088dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "b5fe9835-8278-449e-9069-18421cb088dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "b5fe9835-8278-449e-9069-18421cb088dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:17 user nova-compute[72447]: INFO nova.compute.manager [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Terminating instance
Jul 31 12:28:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-586d292c-c407-4ef2-a082-65d02946f263 req-23eb0194-f326-4728-b55a-62dbc12141d7 service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Received event network-vif-unplugged-4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-586d292c-c407-4ef2-a082-65d02946f263 req-23eb0194-f326-4728-b55a-62dbc12141d7 service nova] Acquiring lock "b5fe9835-8278-449e-9069-18421cb088dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-586d292c-c407-4ef2-a082-65d02946f263 req-23eb0194-f326-4728-b55a-62dbc12141d7 service nova] Lock "b5fe9835-8278-449e-9069-18421cb088dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-586d292c-c407-4ef2-a082-65d02946f263 req-23eb0194-f326-4728-b55a-62dbc12141d7 service nova] Lock "b5fe9835-8278-449e-9069-18421cb088dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-586d292c-c407-4ef2-a082-65d02946f263 req-23eb0194-f326-4728-b55a-62dbc12141d7 service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] No waiting events found dispatching network-vif-unplugged-4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-586d292c-c407-4ef2-a082-65d02946f263 req-23eb0194-f326-4728-b55a-62dbc12141d7 service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Received event network-vif-unplugged-4425eb84-e913-4e73-a372-ae2d5862108e for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:28:17 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Instance destroyed successfully.
Jul 31 12:28:17 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lazy-loading 'resources' on Instance uuid b5fe9835-8278-449e-9069-18421cb088dd {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-977941788',display_name='tempest-ServersNegativeTestJSON-server-977941788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-977941788',id=24,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94646a9f184c43d4abbd4fac64c84344',ramdisk_id='',reservation_id='r-cqg7lv8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1687226877',owner_user_name='tempest-ServersNegativeTestJSON-1687226877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:19:32Z,user_data=None,user_id='f2c57df148eb4814a0b12ca7a6d9eda6',uuid=b5fe9835-8278-449e-9069-18421cb088dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4425eb84-e913-4e73-a372-ae2d5862108e", "address": "fa:16:3e:4d:a3:ab", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4425eb84-e9", "ovs_interfaceid": "4425eb84-e913-4e73-a372-ae2d5862108e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Converting VIF {"id": "4425eb84-e913-4e73-a372-ae2d5862108e", "address": "fa:16:3e:4d:a3:ab", "network": {"id": "314b6cad-9007-4774-833c-c51405af0c5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-739348031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94646a9f184c43d4abbd4fac64c84344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4425eb84-e9", "ovs_interfaceid": "4425eb84-e913-4e73-a372-ae2d5862108e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a3:ab,bridge_name='br-int',has_traffic_filtering=True,id=4425eb84-e913-4e73-a372-ae2d5862108e,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4425eb84-e9') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG os_vif [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a3:ab,bridge_name='br-int',has_traffic_filtering=True,id=4425eb84-e913-4e73-a372-ae2d5862108e,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4425eb84-e9') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4425eb84-e9, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:28:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:28:17 user nova-compute[72447]: INFO os_vif [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a3:ab,bridge_name='br-int',has_traffic_filtering=True,id=4425eb84-e913-4e73-a372-ae2d5862108e,network=Network(314b6cad-9007-4774-833c-c51405af0c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4425eb84-e9')
Jul 31 12:28:17 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Deleting instance files /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd_del
Jul 31 12:28:17 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Deletion of /opt/stack/data/nova/instances/b5fe9835-8278-449e-9069-18421cb088dd_del complete
Jul 31 12:28:18 user nova-compute[72447]: INFO nova.compute.manager [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 31 12:28:18 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:28:18 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:28:18 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: b5fe9835-8278-449e-9069-18421cb088dd] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:28:18 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:28:18 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Took 0.69 seconds to deallocate network for instance.
Jul 31 12:28:18 user nova-compute[72447]: DEBUG nova.compute.manager [req-b852a928-a8f6-447f-a74f-4f4049812129 req-22649570-4077-4bbc-857c-750098461139 service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Received event network-vif-deleted-4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:19 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:28:19 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:28:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:19 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Deleted allocations for instance b5fe9835-8278-449e-9069-18421cb088dd
Jul 31 12:28:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5bb6c994-3359-4a07-bb1b-14769652db90 tempest-ServersNegativeTestJSON-1687226877 tempest-ServersNegativeTestJSON-1687226877-project-member] Lock "b5fe9835-8278-449e-9069-18421cb088dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-8978497e-f5db-4f96-b7a5-3d2f1e56235b req-940b1c22-3dc5-4bc9-9ca5-870f11a1a64a service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Received event network-vif-plugged-4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8978497e-f5db-4f96-b7a5-3d2f1e56235b req-940b1c22-3dc5-4bc9-9ca5-870f11a1a64a service nova] Acquiring lock "b5fe9835-8278-449e-9069-18421cb088dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8978497e-f5db-4f96-b7a5-3d2f1e56235b req-940b1c22-3dc5-4bc9-9ca5-870f11a1a64a service nova] Lock "b5fe9835-8278-449e-9069-18421cb088dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8978497e-f5db-4f96-b7a5-3d2f1e56235b req-940b1c22-3dc5-4bc9-9ca5-870f11a1a64a service nova] Lock "b5fe9835-8278-449e-9069-18421cb088dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-8978497e-f5db-4f96-b7a5-3d2f1e56235b req-940b1c22-3dc5-4bc9-9ca5-870f11a1a64a service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] No waiting events found dispatching network-vif-plugged-4425eb84-e913-4e73-a372-ae2d5862108e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:28:19 user nova-compute[72447]: WARNING nova.compute.manager [req-8978497e-f5db-4f96-b7a5-3d2f1e56235b req-940b1c22-3dc5-4bc9-9ca5-870f11a1a64a service nova] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Received unexpected event network-vif-plugged-4425eb84-e913-4e73-a372-ae2d5862108e for instance with vm_state deleted and task_state None.
Jul 31 12:28:20 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806485.029811, 981b694a-bf63-4f4b-95c5-bc17aa72b87b => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:28:20 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] VM Stopped (Lifecycle Event)
Jul 31 12:28:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d7926571-1dce-41e7-8126-3afc26a2523d None None] [instance: 981b694a-bf63-4f4b-95c5-bc17aa72b87b] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:28:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:28 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806493.304193, c8aaf2f0-737d-4523-9e7a-12237bc41a74 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:28:28 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] VM Stopped (Lifecycle Event)
Jul 31 12:28:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-13f4d210-47f8-4de0-975c-dce927f208fe None None] [instance: c8aaf2f0-737d-4523-9e7a-12237bc41a74] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:28:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:32 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806497.9102194, b5fe9835-8278-449e-9069-18421cb088dd => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:28:32 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: b5fe9835-8278-449e-9069-18421cb088dd] VM Stopped (Lifecycle Event)
Jul 31 12:28:32 user nova-compute[72447]: DEBUG nova.compute.manager [None req-0943d7c3-9c14-4b31-aa63-78f77e22ff77 None None] [instance: b5fe9835-8278-449e-9069-18421cb088dd] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:28:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:39 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Going to confirm migration 2 {{(pid=72447) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Jul 31 12:28:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:28:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquired lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:28:39 user nova-compute[72447]: DEBUG nova.network.neutron [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:28:39 user nova-compute[72447]: DEBUG nova.objects.instance [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'info_cache' on Instance uuid 2a481721-232b-4a4d-83ad-cfbac144bb5e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:28:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:39 user nova-compute[72447]: DEBUG nova.network.neutron [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updating instance_info_cache with network_info: [{"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:28:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Releasing lock "refresh_cache-2a481721-232b-4a4d-83ad-cfbac144bb5e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:28:39 user nova-compute[72447]: DEBUG nova.objects.instance [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'migration_context' on Instance uuid 2a481721-232b-4a4d-83ad-cfbac144bb5e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:28:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:40 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:28:40 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:28:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.402s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:40 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Deleted allocation for migration 80bd52de-365a-4151-9be1-e6372710ef40
Jul 31 12:28:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4bfe9d8-f6cf-4cac-badb-0d764c24f735 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.643s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:46 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:28:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:28:46 user nova-compute[72447]: INFO nova.compute.claims [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Claim successful on node user
Jul 31 12:28:47 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG nova.network.neutron [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:28:47 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:28:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG nova.policy [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55651d199ea94f2085d7f2950da100f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fef08187154b7da8fc1af9e8960a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:28:47 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Creating image(s)
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "/opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "/opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk 1073741824" returned: 0 in 0.054s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Cannot resize image /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lazy-loading 'migration_context' on Instance uuid d4bd5550-6cd3-4177-afbd-1e4981eeec99 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Ensure instance console log exists: /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Successfully created port: 3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG nova.network.neutron [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Successfully updated port: 3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-e6260da0-54b2-4a0f-9566-5c314c764786 req-6c067466-75cd-4438-8b4d-48004495ecca service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Received event network-changed-3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-e6260da0-54b2-4a0f-9566-5c314c764786 req-6c067466-75cd-4438-8b4d-48004495ecca service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Refreshing instance network info cache due to event network-changed-3d8642ff-7536-43c2-b539-addb31e07e9c. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e6260da0-54b2-4a0f-9566-5c314c764786 req-6c067466-75cd-4438-8b4d-48004495ecca service nova] Acquiring lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:28:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e6260da0-54b2-4a0f-9566-5c314c764786 req-6c067466-75cd-4438-8b4d-48004495ecca service nova] Acquired lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.network.neutron [req-e6260da0-54b2-4a0f-9566-5c314c764786 req-6c067466-75cd-4438-8b4d-48004495ecca service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Refreshing network info cache for port 3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.network.neutron [req-e6260da0-54b2-4a0f-9566-5c314c764786 req-6c067466-75cd-4438-8b4d-48004495ecca service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.network.neutron [req-e6260da0-54b2-4a0f-9566-5c314c764786 req-6c067466-75cd-4438-8b4d-48004495ecca service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e6260da0-54b2-4a0f-9566-5c314c764786 req-6c067466-75cd-4438-8b4d-48004495ecca service nova] Releasing lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquired lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.network.neutron [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.network.neutron [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.network.neutron [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Updating instance_info_cache with network_info: [{"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Releasing lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Instance network_info: |[{"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Start _get_guest_xml network_info=[{"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:28:49 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:28:49 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:28:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-931000092',display_name='tempest-TestStampPattern-server-931000092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-931000092',id=38,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyqS6WM/VxoajJCxkzqFbYmyaWdRi6cEk7Qi4JAyZ2mMuFpcq2L/28ah02VGBE9ktZbXYHxyezmKduAO5nTjd+L4At4n2ckFxT9WdPLRl0ZpDmeip6oN8T4/B1+t44T7g==',key_name='tempest-TestStampPattern-2046413804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20fef08187154b7da8fc1af9e8960a1b',ramdisk_id='',reservation_id='r-7l07gtog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1760569238',owner_user_name='tempest-TestStampPattern-1760569238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:28:47Z,user_data=None,user_id='55651d199ea94f2085d7f2950da100f9',uuid=d4bd5550-6cd3-4177-afbd-1e4981eeec99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Converting VIF {"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a4:49,bridge_name='br-int',has_traffic_filtering=True,id=3d8642ff-7536-43c2-b539-addb31e07e9c,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8642ff-75') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lazy-loading 'pci_devices' on Instance uuid d4bd5550-6cd3-4177-afbd-1e4981eeec99 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:28:49 user nova-compute[72447]:   <uuid>d4bd5550-6cd3-4177-afbd-1e4981eeec99</uuid>
Jul 31 12:28:49 user nova-compute[72447]:   <name>instance-00000026</name>
Jul 31 12:28:49 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:28:49 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:28:49 user nova-compute[72447]:   <metadata>
Jul 31 12:28:49 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:28:49 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:28:49 user nova-compute[72447]:       <nova:name>tempest-TestStampPattern-server-931000092</nova:name>
Jul 31 12:28:49 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:28:49</nova:creationTime>
Jul 31 12:28:49 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:28:49 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:28:49 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:28:49 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:28:49 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:28:49 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:28:49 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:28:49 user nova-compute[72447]:       <nova:owner>
Jul 31 12:28:49 user nova-compute[72447]:         <nova:user uuid="55651d199ea94f2085d7f2950da100f9">tempest-TestStampPattern-1760569238-project-member</nova:user>
Jul 31 12:28:49 user nova-compute[72447]:         <nova:project uuid="20fef08187154b7da8fc1af9e8960a1b">tempest-TestStampPattern-1760569238</nova:project>
Jul 31 12:28:49 user nova-compute[72447]:       </nova:owner>
Jul 31 12:28:49 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:28:49 user nova-compute[72447]:       <nova:ports>
Jul 31 12:28:49 user nova-compute[72447]:         <nova:port uuid="3d8642ff-7536-43c2-b539-addb31e07e9c">
Jul 31 12:28:49 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 12:28:49 user nova-compute[72447]:         </nova:port>
Jul 31 12:28:49 user nova-compute[72447]:       </nova:ports>
Jul 31 12:28:49 user nova-compute[72447]:     </nova:instance>
Jul 31 12:28:49 user nova-compute[72447]:   </metadata>
Jul 31 12:28:49 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:28:49 user nova-compute[72447]:     <system>
Jul 31 12:28:49 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:28:49 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:28:49 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:28:49 user nova-compute[72447]:       <entry name="serial">d4bd5550-6cd3-4177-afbd-1e4981eeec99</entry>
Jul 31 12:28:49 user nova-compute[72447]:       <entry name="uuid">d4bd5550-6cd3-4177-afbd-1e4981eeec99</entry>
Jul 31 12:28:49 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:28:49 user nova-compute[72447]:     </system>
Jul 31 12:28:49 user nova-compute[72447]:   </sysinfo>
Jul 31 12:28:49 user nova-compute[72447]:   <os>
Jul 31 12:28:49 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:28:49 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:28:49 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:28:49 user nova-compute[72447]:   </os>
Jul 31 12:28:49 user nova-compute[72447]:   <features>
Jul 31 12:28:49 user nova-compute[72447]:     <acpi/>
Jul 31 12:28:49 user nova-compute[72447]:     <apic/>
Jul 31 12:28:49 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:28:49 user nova-compute[72447]:   </features>
Jul 31 12:28:49 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:28:49 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:28:49 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:28:49 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:28:49 user nova-compute[72447]:   </clock>
Jul 31 12:28:49 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:28:49 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:28:49 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:28:49 user nova-compute[72447]:   </cpu>
Jul 31 12:28:49 user nova-compute[72447]:   <devices>
Jul 31 12:28:49 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:28:49 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:28:49 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk"/>
Jul 31 12:28:49 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:28:49 user nova-compute[72447]:     </disk>
Jul 31 12:28:49 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:28:49 user nova-compute[72447]:       <mac address="fa:16:3e:05:a4:49"/>
Jul 31 12:28:49 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:28:49 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:28:49 user nova-compute[72447]:       <target dev="tap3d8642ff-75"/>
Jul 31 12:28:49 user nova-compute[72447]:     </interface>
Jul 31 12:28:49 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:28:49 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/console.log" append="off"/>
Jul 31 12:28:49 user nova-compute[72447]:     </serial>
Jul 31 12:28:49 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:28:49 user nova-compute[72447]:     <video>
Jul 31 12:28:49 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:28:49 user nova-compute[72447]:     </video>
Jul 31 12:28:49 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:28:49 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:28:49 user nova-compute[72447]:     </rng>
Jul 31 12:28:49 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:28:49 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:28:49 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:28:49 user nova-compute[72447]:     </memballoon>
Jul 31 12:28:49 user nova-compute[72447]:   </devices>
Jul 31 12:28:49 user nova-compute[72447]: </domain>
Jul 31 12:28:49 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:28:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-931000092',display_name='tempest-TestStampPattern-server-931000092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-931000092',id=38,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyqS6WM/VxoajJCxkzqFbYmyaWdRi6cEk7Qi4JAyZ2mMuFpcq2L/28ah02VGBE9ktZbXYHxyezmKduAO5nTjd+L4At4n2ckFxT9WdPLRl0ZpDmeip6oN8T4/B1+t44T7g==',key_name='tempest-TestStampPattern-2046413804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20fef08187154b7da8fc1af9e8960a1b',ramdisk_id='',reservation_id='r-7l07gtog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1760569238',owner_user_name='tempest-TestStampPattern-1760569238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:28:47Z,user_data=None,user_id='55651d199ea94f2085d7f2950da100f9',uuid=d4bd5550-6cd3-4177-afbd-1e4981eeec99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Converting VIF {"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a4:49,bridge_name='br-int',has_traffic_filtering=True,id=3d8642ff-7536-43c2-b539-addb31e07e9c,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8642ff-75') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG os_vif [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a4:49,bridge_name='br-int',has_traffic_filtering=True,id=3d8642ff-7536-43c2-b539-addb31e07e9c,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8642ff-75') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d8642ff-75, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d8642ff-75, col_values=(('external_ids', {'iface-id': '3d8642ff-7536-43c2-b539-addb31e07e9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:a4:49', 'vm-uuid': 'd4bd5550-6cd3-4177-afbd-1e4981eeec99'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:28:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:49 user nova-compute[72447]: INFO os_vif [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a4:49,bridge_name='br-int',has_traffic_filtering=True,id=3d8642ff-7536-43c2-b539-addb31e07e9c,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8642ff-75')
Jul 31 12:28:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:28:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] No VIF found with MAC fa:16:3e:05:a4:49, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:28:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-aca4bb55-d525-41f4-8c89-c1cc0ba49f80 req-aebfb3ec-adad-463d-8813-048224a438da service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Received event network-changed-e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-aca4bb55-d525-41f4-8c89-c1cc0ba49f80 req-aebfb3ec-adad-463d-8813-048224a438da service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Refreshing instance network info cache due to event network-changed-e553a5d8-d071-4c12-995b-74d2cf9d343c. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-aca4bb55-d525-41f4-8c89-c1cc0ba49f80 req-aebfb3ec-adad-463d-8813-048224a438da service nova] Acquiring lock "refresh_cache-cf664b3e-d48f-45d1-b47e-53e81c769054" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-aca4bb55-d525-41f4-8c89-c1cc0ba49f80 req-aebfb3ec-adad-463d-8813-048224a438da service nova] Acquired lock "refresh_cache-cf664b3e-d48f-45d1-b47e-53e81c769054" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG nova.network.neutron [req-aca4bb55-d525-41f4-8c89-c1cc0ba49f80 req-aebfb3ec-adad-463d-8813-048224a438da service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Refreshing network info cache for port e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-6dcf2b5c-468e-4e26-b360-591968ab2f94 req-0c68ed16-0941-4177-8ce3-670b91999ae6 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Received event network-vif-plugged-3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6dcf2b5c-468e-4e26-b360-591968ab2f94 req-0c68ed16-0941-4177-8ce3-670b91999ae6 service nova] Acquiring lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6dcf2b5c-468e-4e26-b360-591968ab2f94 req-0c68ed16-0941-4177-8ce3-670b91999ae6 service nova] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6dcf2b5c-468e-4e26-b360-591968ab2f94 req-0c68ed16-0941-4177-8ce3-670b91999ae6 service nova] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-6dcf2b5c-468e-4e26-b360-591968ab2f94 req-0c68ed16-0941-4177-8ce3-670b91999ae6 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] No waiting events found dispatching network-vif-plugged-3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:28:51 user nova-compute[72447]: WARNING nova.compute.manager [req-6dcf2b5c-468e-4e26-b360-591968ab2f94 req-0c68ed16-0941-4177-8ce3-670b91999ae6 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Received unexpected event network-vif-plugged-3d8642ff-7536-43c2-b539-addb31e07e9c for instance with vm_state building and task_state spawning.
Jul 31 12:28:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "cf664b3e-d48f-45d1-b47e-53e81c769054" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG nova.objects.instance [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lazy-loading 'flavor' on Instance uuid cf664b3e-d48f-45d1-b47e-53e81c769054 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:28:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:51 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Ignoring supplied device name: /dev/vdb
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "cf664b3e-d48f-45d1-b47e-53e81c769054" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:52 user nova-compute[72447]: INFO nova.compute.manager [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Attaching volume ca47d9c0-60a5-48ba-9415-c080e569e287 to /dev/vdb
Jul 31 12:28:52 user nova-compute[72447]: DEBUG os_brick.utils [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d359172-cb11-408a-b8b0-08f8ef755d8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG nova.network.neutron [req-aca4bb55-d525-41f4-8c89-c1cc0ba49f80 req-aebfb3ec-adad-463d-8813-048224a438da service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Updated VIF entry in instance network info cache for port e553a5d8-d071-4c12-995b-74d2cf9d343c. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG nova.network.neutron [req-aca4bb55-d525-41f4-8c89-c1cc0ba49f80 req-aebfb3ec-adad-463d-8813-048224a438da service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Updating instance_info_cache with network_info: [{"id": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "address": "fa:16:3e:0c:f8:c3", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape553a5d8-d0", "ovs_interfaceid": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8977d876-db48-403e-b551-f90bbc4352b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-aca4bb55-d525-41f4-8c89-c1cc0ba49f80 req-aebfb3ec-adad-463d-8813-048224a438da service nova] Releasing lock "refresh_cache-cf664b3e-d48f-45d1-b47e-53e81c769054" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b28fe1c-5b2f-4a90-9357-e68b214cd9b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5654b8bf-002f-40b7-98c8-81037bb145db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:28:52 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:28:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63aaa04-153a-4fdd-94a8-7033b8e9e370]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG os_brick.utils [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:28:52 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Updating existing volume attachment record: 800f740e-2970-445a-b63b-72fe14f00cd4 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:28:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806533.603167, d4bd5550-6cd3-4177-afbd-1e4981eeec99 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:28:53 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] VM Resumed (Lifecycle Event)
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:28:53 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Instance spawned successfully.
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:28:53 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806533.603628, d4bd5550-6cd3-4177-afbd-1e4981eeec99 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:28:53 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] VM Started (Lifecycle Event)
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:28:53 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:28:53 user nova-compute[72447]: INFO nova.compute.manager [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Took 6.30 seconds to spawn the instance on the hypervisor.
Jul 31 12:28:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:28:53 user nova-compute[72447]: INFO nova.compute.manager [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Took 7.33 seconds to build instance.
Jul 31 12:28:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fbec803f-c206-4031-9bb5-7372c85396f6 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.432s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-4d23b592-bdf3-41c0-8f43-5686d8fc2787 req-0ebe10fe-f937-4b41-ac11-4a1db831225d service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Received event network-vif-plugged-3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:28:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4d23b592-bdf3-41c0-8f43-5686d8fc2787 req-0ebe10fe-f937-4b41-ac11-4a1db831225d service nova] Acquiring lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4d23b592-bdf3-41c0-8f43-5686d8fc2787 req-0ebe10fe-f937-4b41-ac11-4a1db831225d service nova] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4d23b592-bdf3-41c0-8f43-5686d8fc2787 req-0ebe10fe-f937-4b41-ac11-4a1db831225d service nova] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:28:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-4d23b592-bdf3-41c0-8f43-5686d8fc2787 req-0ebe10fe-f937-4b41-ac11-4a1db831225d service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] No waiting events found dispatching network-vif-plugged-3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:28:54 user nova-compute[72447]: WARNING nova.compute.manager [req-4d23b592-bdf3-41c0-8f43-5686d8fc2787 req-0ebe10fe-f937-4b41-ac11-4a1db831225d service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Received unexpected event network-vif-plugged-3d8642ff-7536-43c2-b539-addb31e07e9c for instance with vm_state active and task_state None.
Jul 31 12:28:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:57 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:28:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:28:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:28:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:28:59 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:29:00 user nova-compute[72447]: INFO nova.compute.claims [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Claim successful on node user
Jul 31 12:29:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG nova.network.neutron [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:29:00 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:29:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG nova.policy [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33486507bb4141d1a1753054199bce56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7c1764cced4b49ad8e55759362a8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:29:00 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Creating image(s)
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "/opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "/opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "/opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.162s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYZHztgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:29:01 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:29:01 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:29:01 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfd28c1-433a-4766-99d9-362fdc0a7e9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:29:01 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[59455735-b2aa-49ef-bd3d-8646da68de6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287] added
Jul 31 12:29:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b404d3-b010-4de2-87b1-47120b255d60]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk 1073741824" returned: 0 in 0.051s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a358974c-c9bb-47f0-a6b3-2c90f1906306]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYZHztgx {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYZHztgx" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2277ce2-8248-4cd3-aac9-eaccdc757f45]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bYZHztgx'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f39f5f-fcf3-455f-a56a-828e3cde79c7]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b199c-458e-4bff-9eb0-c2bec32f8f1c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:29:01 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:29:01 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:29:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:29:01 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:29:01 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:29:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.150s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f719a49-2534-4838-b295-88ffdcec6559]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287, portal: 172.16.0.220,3260]
Jul 31 12:29:01 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287, portal: 172.16.0.220,3260] successful.
Jul 31 12:29:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[40019777-40b7-468c-ade7-b985771ca772]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9792588c-0599-4d6e-92e0-a84ca549e403]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:29:01 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:29:01 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:29:01 user nova-compute[72447]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 (non-flash)
Jul 31 12:29:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:29:01 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:29:01 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:29:01 user nova-compute[72447]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 (non-flash)
Jul 31 12:29:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac7f3c7-7fc4-4519-80c7-364978cb41c9]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYZHztgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Cannot resize image /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG nova.objects.instance [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'migration_context' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Ensure instance console log exists: /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:01 user nova-compute[72447]: DEBUG nova.network.neutron [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Successfully created port: 23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG nova.network.neutron [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Successfully updated port: 23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquired lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG nova.network.neutron [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-99c1a064-59e3-4ea9-a435-323a980709f2 req-1dcedad9-1b4b-4632-be31-d19f7cc39c00 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-changed-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-99c1a064-59e3-4ea9-a435-323a980709f2 req-1dcedad9-1b4b-4632-be31-d19f7cc39c00 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Refreshing instance network info cache due to event network-changed-23148cca-e577-4eaa-ab83-b87a4d7dd713. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-99c1a064-59e3-4ea9-a435-323a980709f2 req-1dcedad9-1b4b-4632-be31-d19f7cc39c00 service nova] Acquiring lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '26137656264653736', 'path': '/dev/sde'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137656264653736', 'path': '/dev/sde'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG nova.objects.instance [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lazy-loading 'flavor' on Instance uuid cf664b3e-d48f-45d1-b47e-53e81c769054 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:29:02 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:29:02 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:29:02 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:29:02 user nova-compute[72447]:   <serial>ca47d9c0-60a5-48ba-9415-c080e569e287</serial>
Jul 31 12:29:02 user nova-compute[72447]: </disk>
Jul 31 12:29:02 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG nova.network.neutron [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:29:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] No VIF found with MAC fa:16:3e:0c:f8:c3, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-97465a87-8ad1-4530-a12b-7245934f1b25 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.965s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.network.neutron [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updating instance_info_cache with network_info: [{"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Releasing lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance network_info: |[{"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-99c1a064-59e3-4ea9-a435-323a980709f2 req-1dcedad9-1b4b-4632-be31-d19f7cc39c00 service nova] Acquired lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.network.neutron [req-99c1a064-59e3-4ea9-a435-323a980709f2 req-1dcedad9-1b4b-4632-be31-d19f7cc39c00 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Refreshing network info cache for port 23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Start _get_guest_xml network_info=[{"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:29:03 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:29:03 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:29:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:28:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-675334656',display_name='tempest-AttachVolumeTestJSON-server-675334656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-675334656',id=39,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjaiwoFel2Eh2TCakrkW9agvz+yoDwe/zWXpzkLHB0ZWZVJFVho0opNQvvQrNB2zUmhAKykfMwu2NDRbQKV/RDfX39Ice4f0JVuhVt96pRXbOIBk6k5FqAJVOMHKQRawg==',key_name='tempest-keypair-1537936122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f7c1764cced4b49ad8e55759362a8db',ramdisk_id='',reservation_id='r-p6axrgt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-182433734',owner_user_name='tempest-AttachVolumeTestJSON-182433734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:29:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33486507bb4141d1a1753054199bce56',uuid=43b9c1c3-280c-4c26-9435-e50d29b3d8d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converting VIF {"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG nova.objects.instance [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'pci_devices' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:29:04 user nova-compute[72447]:   <uuid>43b9c1c3-280c-4c26-9435-e50d29b3d8d6</uuid>
Jul 31 12:29:04 user nova-compute[72447]:   <name>instance-00000027</name>
Jul 31 12:29:04 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:29:04 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:29:04 user nova-compute[72447]:   <metadata>
Jul 31 12:29:04 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:29:04 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:29:04 user nova-compute[72447]:       <nova:name>tempest-AttachVolumeTestJSON-server-675334656</nova:name>
Jul 31 12:29:04 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:29:03</nova:creationTime>
Jul 31 12:29:04 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:29:04 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:29:04 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:29:04 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:29:04 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:29:04 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:29:04 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:29:04 user nova-compute[72447]:       <nova:owner>
Jul 31 12:29:04 user nova-compute[72447]:         <nova:user uuid="33486507bb4141d1a1753054199bce56">tempest-AttachVolumeTestJSON-182433734-project-member</nova:user>
Jul 31 12:29:04 user nova-compute[72447]:         <nova:project uuid="6f7c1764cced4b49ad8e55759362a8db">tempest-AttachVolumeTestJSON-182433734</nova:project>
Jul 31 12:29:04 user nova-compute[72447]:       </nova:owner>
Jul 31 12:29:04 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:29:04 user nova-compute[72447]:       <nova:ports>
Jul 31 12:29:04 user nova-compute[72447]:         <nova:port uuid="23148cca-e577-4eaa-ab83-b87a4d7dd713">
Jul 31 12:29:04 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 12:29:04 user nova-compute[72447]:         </nova:port>
Jul 31 12:29:04 user nova-compute[72447]:       </nova:ports>
Jul 31 12:29:04 user nova-compute[72447]:     </nova:instance>
Jul 31 12:29:04 user nova-compute[72447]:   </metadata>
Jul 31 12:29:04 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:29:04 user nova-compute[72447]:     <system>
Jul 31 12:29:04 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:29:04 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:29:04 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:29:04 user nova-compute[72447]:       <entry name="serial">43b9c1c3-280c-4c26-9435-e50d29b3d8d6</entry>
Jul 31 12:29:04 user nova-compute[72447]:       <entry name="uuid">43b9c1c3-280c-4c26-9435-e50d29b3d8d6</entry>
Jul 31 12:29:04 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:29:04 user nova-compute[72447]:     </system>
Jul 31 12:29:04 user nova-compute[72447]:   </sysinfo>
Jul 31 12:29:04 user nova-compute[72447]:   <os>
Jul 31 12:29:04 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:29:04 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:29:04 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:29:04 user nova-compute[72447]:   </os>
Jul 31 12:29:04 user nova-compute[72447]:   <features>
Jul 31 12:29:04 user nova-compute[72447]:     <acpi/>
Jul 31 12:29:04 user nova-compute[72447]:     <apic/>
Jul 31 12:29:04 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:29:04 user nova-compute[72447]:   </features>
Jul 31 12:29:04 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:29:04 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:29:04 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:29:04 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:29:04 user nova-compute[72447]:   </clock>
Jul 31 12:29:04 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:29:04 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:29:04 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:29:04 user nova-compute[72447]:   </cpu>
Jul 31 12:29:04 user nova-compute[72447]:   <devices>
Jul 31 12:29:04 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:29:04 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:29:04 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk"/>
Jul 31 12:29:04 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:29:04 user nova-compute[72447]:     </disk>
Jul 31 12:29:04 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:29:04 user nova-compute[72447]:       <mac address="fa:16:3e:0c:31:61"/>
Jul 31 12:29:04 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:29:04 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:29:04 user nova-compute[72447]:       <target dev="tap23148cca-e5"/>
Jul 31 12:29:04 user nova-compute[72447]:     </interface>
Jul 31 12:29:04 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:29:04 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/console.log" append="off"/>
Jul 31 12:29:04 user nova-compute[72447]:     </serial>
Jul 31 12:29:04 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:29:04 user nova-compute[72447]:     <video>
Jul 31 12:29:04 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:29:04 user nova-compute[72447]:     </video>
Jul 31 12:29:04 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:29:04 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:29:04 user nova-compute[72447]:     </rng>
Jul 31 12:29:04 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:29:04 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:29:04 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:29:04 user nova-compute[72447]:     </memballoon>
Jul 31 12:29:04 user nova-compute[72447]:   </devices>
Jul 31 12:29:04 user nova-compute[72447]: </domain>
Jul 31 12:29:04 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:28:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-675334656',display_name='tempest-AttachVolumeTestJSON-server-675334656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-675334656',id=39,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjaiwoFel2Eh2TCakrkW9agvz+yoDwe/zWXpzkLHB0ZWZVJFVho0opNQvvQrNB2zUmhAKykfMwu2NDRbQKV/RDfX39Ice4f0JVuhVt96pRXbOIBk6k5FqAJVOMHKQRawg==',key_name='tempest-keypair-1537936122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f7c1764cced4b49ad8e55759362a8db',ramdisk_id='',reservation_id='r-p6axrgt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-182433734',owner_user_name='tempest-AttachVolumeTestJSON-182433734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:29:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33486507bb4141d1a1753054199bce56',uuid=43b9c1c3-280c-4c26-9435-e50d29b3d8d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converting VIF {"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG os_vif [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23148cca-e5, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23148cca-e5, col_values=(('external_ids', {'iface-id': '23148cca-e577-4eaa-ab83-b87a4d7dd713', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:31:61', 'vm-uuid': '43b9c1c3-280c-4c26-9435-e50d29b3d8d6'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:04 user nova-compute[72447]: INFO os_vif [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5')
Jul 31 12:29:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No VIF found with MAC fa:16:3e:0c:31:61, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG nova.network.neutron [req-99c1a064-59e3-4ea9-a435-323a980709f2 req-1dcedad9-1b4b-4632-be31-d19f7cc39c00 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updated VIF entry in instance network info cache for port 23148cca-e577-4eaa-ab83-b87a4d7dd713. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG nova.network.neutron [req-99c1a064-59e3-4ea9-a435-323a980709f2 req-1dcedad9-1b4b-4632-be31-d19f7cc39c00 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updating instance_info_cache with network_info: [{"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:29:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-99c1a064-59e3-4ea9-a435-323a980709f2 req-1dcedad9-1b4b-4632-be31-d19f7cc39c00 service nova] Releasing lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-c4ab6ae6-0c02-4c18-8a88-20e346d2b2b9 req-1777cd21-7906-4446-9438-d1b0e903d18d service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c4ab6ae6-0c02-4c18-8a88-20e346d2b2b9 req-1777cd21-7906-4446-9438-d1b0e903d18d service nova] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c4ab6ae6-0c02-4c18-8a88-20e346d2b2b9 req-1777cd21-7906-4446-9438-d1b0e903d18d service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c4ab6ae6-0c02-4c18-8a88-20e346d2b2b9 req-1777cd21-7906-4446-9438-d1b0e903d18d service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-c4ab6ae6-0c02-4c18-8a88-20e346d2b2b9 req-1777cd21-7906-4446-9438-d1b0e903d18d service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] No waiting events found dispatching network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:29:05 user nova-compute[72447]: WARNING nova.compute.manager [req-c4ab6ae6-0c02-4c18-8a88-20e346d2b2b9 req-1777cd21-7906-4446-9438-d1b0e903d18d service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received unexpected event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 for instance with vm_state building and task_state spawning.
Jul 31 12:29:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:29:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-a7160a5e-7b55-42e5-a725-2ddbef78fd5e req-0935f0d6-10a6-4343-a1e2-ae703fa0b2a3 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a7160a5e-7b55-42e5-a725-2ddbef78fd5e req-0935f0d6-10a6-4343-a1e2-ae703fa0b2a3 service nova] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a7160a5e-7b55-42e5-a725-2ddbef78fd5e req-0935f0d6-10a6-4343-a1e2-ae703fa0b2a3 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a7160a5e-7b55-42e5-a725-2ddbef78fd5e req-0935f0d6-10a6-4343-a1e2-ae703fa0b2a3 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-a7160a5e-7b55-42e5-a725-2ddbef78fd5e req-0935f0d6-10a6-4343-a1e2-ae703fa0b2a3 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] No waiting events found dispatching network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:29:07 user nova-compute[72447]: WARNING nova.compute.manager [req-a7160a5e-7b55-42e5-a725-2ddbef78fd5e req-0935f0d6-10a6-4343-a1e2-ae703fa0b2a3 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received unexpected event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 for instance with vm_state building and task_state spawning.
Jul 31 12:29:07 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806547.9668458, 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:29:07 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] VM Resumed (Lifecycle Event)
Jul 31 12:29:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:29:07 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance spawned successfully.
Jul 31 12:29:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:29:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:29:08 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806547.968059, 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:29:08 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] VM Started (Lifecycle Event)
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:08 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:29:08 user nova-compute[72447]: INFO nova.compute.manager [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Took 7.34 seconds to spawn the instance on the hypervisor.
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:08 user nova-compute[72447]: INFO nova.compute.manager [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Took 8.31 seconds to build instance.
Jul 31 12:29:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-16f85b7f-7d90-4297-ae31-3ea6a1932e84 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.438s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:09 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:29:09 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7366MB free_disk=25.109966278076172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Acquiring lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Acquiring lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:09 user nova-compute[72447]: INFO nova.compute.manager [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Terminating instance
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance f3f1534b-16c0-4dee-b78c-d53713113a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2a481721-232b-4a4d-83ad-cfbac144bb5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance cf664b3e-d48f-45d1-b47e-53e81c769054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-9582020f-5708-4589-ad2c-4a4a90de8dfe req-344a6371-fe48-493a-a9fa-ff3ef1a0c87b service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Received event network-vif-unplugged-908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9582020f-5708-4589-ad2c-4a4a90de8dfe req-344a6371-fe48-493a-a9fa-ff3ef1a0c87b service nova] Acquiring lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9582020f-5708-4589-ad2c-4a4a90de8dfe req-344a6371-fe48-493a-a9fa-ff3ef1a0c87b service nova] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9582020f-5708-4589-ad2c-4a4a90de8dfe req-344a6371-fe48-493a-a9fa-ff3ef1a0c87b service nova] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-9582020f-5708-4589-ad2c-4a4a90de8dfe req-344a6371-fe48-493a-a9fa-ff3ef1a0c87b service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] No waiting events found dispatching network-vif-unplugged-908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-9582020f-5708-4589-ad2c-4a4a90de8dfe req-344a6371-fe48-493a-a9fa-ff3ef1a0c87b service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Received event network-vif-unplugged-908a0ded-2797-4c92-9591-aad6875b3e6b for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:29:09 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.738s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:10 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Instance destroyed successfully.
Jul 31 12:29:10 user nova-compute[72447]: DEBUG nova.objects.instance [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lazy-loading 'resources' on Instance uuid 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:27:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1973052574',display_name='tempest-VolumesNegativeTest-instance-1973052574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1973052574',id=36,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:27:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0ef5d9b809b4c809bbb0d80475ccc01',ramdisk_id='',reservation_id='r-bi2b7pwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-905105624',owner_user_name='tempest-VolumesNegativeTest-905105624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:27:28Z,user_data=None,user_id='6e75eb0b88444fb7a7076d0fad355b27',uuid=36b623bd-370d-4cb5-81e6-0ee3d20ed8a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "908a0ded-2797-4c92-9591-aad6875b3e6b", "address": "fa:16:3e:be:e0:2f", "network": {"id": "289d41ce-5531-498b-ab8c-8ca1dec728f4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b939df8aa3284b29bb9a09babf15f826", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a0ded-27", "ovs_interfaceid": "908a0ded-2797-4c92-9591-aad6875b3e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Converting VIF {"id": "908a0ded-2797-4c92-9591-aad6875b3e6b", "address": "fa:16:3e:be:e0:2f", "network": {"id": "289d41ce-5531-498b-ab8c-8ca1dec728f4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b939df8aa3284b29bb9a09babf15f826", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a0ded-27", "ovs_interfaceid": "908a0ded-2797-4c92-9591-aad6875b3e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:e0:2f,bridge_name='br-int',has_traffic_filtering=True,id=908a0ded-2797-4c92-9591-aad6875b3e6b,network=Network(289d41ce-5531-498b-ab8c-8ca1dec728f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a0ded-27') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG os_vif [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:e0:2f,bridge_name='br-int',has_traffic_filtering=True,id=908a0ded-2797-4c92-9591-aad6875b3e6b,network=Network(289d41ce-5531-498b-ab8c-8ca1dec728f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a0ded-27') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap908a0ded-27, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:29:10 user nova-compute[72447]: INFO os_vif [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:e0:2f,bridge_name='br-int',has_traffic_filtering=True,id=908a0ded-2797-4c92-9591-aad6875b3e6b,network=Network(289d41ce-5531-498b-ab8c-8ca1dec728f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a0ded-27')
Jul 31 12:29:10 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Deleting instance files /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4_del
Jul 31 12:29:10 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Deletion of /opt/stack/data/nova/instances/36b623bd-370d-4cb5-81e6-0ee3d20ed8a4_del complete
Jul 31 12:29:10 user nova-compute[72447]: INFO nova.compute.manager [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 31 12:29:10 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:29:10 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:29:11 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:29:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-fa2ecddc-c89c-4a14-a4b0-b5ba45d5aacb req-dd57836a-0e69-449f-a066-309d75f8b391 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Received event network-vif-deleted-908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:11 user nova-compute[72447]: INFO nova.compute.manager [req-fa2ecddc-c89c-4a14-a4b0-b5ba45d5aacb req-dd57836a-0e69-449f-a066-309d75f8b391 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Neutron deleted interface 908a0ded-2797-4c92-9591-aad6875b3e6b; detaching it from the instance and deleting it from the info cache
Jul 31 12:29:11 user nova-compute[72447]: DEBUG nova.network.neutron [req-fa2ecddc-c89c-4a14-a4b0-b5ba45d5aacb req-dd57836a-0e69-449f-a066-309d75f8b391 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:29:11 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Took 1.08 seconds to deallocate network for instance.
Jul 31 12:29:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-fa2ecddc-c89c-4a14-a4b0-b5ba45d5aacb req-dd57836a-0e69-449f-a066-309d75f8b391 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Detach interface failed, port_id=908a0ded-2797-4c92-9591-aad6875b3e6b, reason: Instance 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4 could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:29:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-4066b0d4-3404-4ee3-b320-0cff783c6b53 req-aae9cc38-49c4-4ffb-b612-a869e8d8bc60 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Received event network-vif-plugged-908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4066b0d4-3404-4ee3-b320-0cff783c6b53 req-aae9cc38-49c4-4ffb-b612-a869e8d8bc60 service nova] Acquiring lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4066b0d4-3404-4ee3-b320-0cff783c6b53 req-aae9cc38-49c4-4ffb-b612-a869e8d8bc60 service nova] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4066b0d4-3404-4ee3-b320-0cff783c6b53 req-aae9cc38-49c4-4ffb-b612-a869e8d8bc60 service nova] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-4066b0d4-3404-4ee3-b320-0cff783c6b53 req-aae9cc38-49c4-4ffb-b612-a869e8d8bc60 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] No waiting events found dispatching network-vif-plugged-908a0ded-2797-4c92-9591-aad6875b3e6b {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:29:11 user nova-compute[72447]: WARNING nova.compute.manager [req-4066b0d4-3404-4ee3-b320-0cff783c6b53 req-aae9cc38-49c4-4ffb-b612-a869e8d8bc60 service nova] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Received unexpected event network-vif-plugged-908a0ded-2797-4c92-9591-aad6875b3e6b for instance with vm_state deleted and task_state None.
Jul 31 12:29:12 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:29:12 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:29:12 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:29:12 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:29:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.599s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:12 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Deleted allocations for instance 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4
Jul 31 12:29:12 user nova-compute[72447]: INFO nova.compute.manager [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Rescuing
Jul 31 12:29:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "refresh_cache-6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:29:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquired lock "refresh_cache-6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:29:12 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:29:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-12356112-4529-4dda-8f91-c8fb32f6a33f tempest-VolumesNegativeTest-905105624 tempest-VolumesNegativeTest-905105624-project-member] Lock "36b623bd-370d-4cb5-81e6-0ee3d20ed8a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.006s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:13 user nova-compute[72447]: DEBUG nova.network.neutron [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Updating instance_info_cache with network_info: [{"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:29:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Releasing lock "refresh_cache-6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:29:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-c3b730fd-4189-4c26-a58d-dce15f0b8b01 req-844b9d61-fd82-46a7-846a-0bbe2dd86f43 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-unplugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c3b730fd-4189-4c26-a58d-dce15f0b8b01 req-844b9d61-fd82-46a7-846a-0bbe2dd86f43 service nova] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c3b730fd-4189-4c26-a58d-dce15f0b8b01 req-844b9d61-fd82-46a7-846a-0bbe2dd86f43 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c3b730fd-4189-4c26-a58d-dce15f0b8b01 req-844b9d61-fd82-46a7-846a-0bbe2dd86f43 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-c3b730fd-4189-4c26-a58d-dce15f0b8b01 req-844b9d61-fd82-46a7-846a-0bbe2dd86f43 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] No waiting events found dispatching network-vif-unplugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:29:13 user nova-compute[72447]: WARNING nova.compute.manager [req-c3b730fd-4189-4c26-a58d-dce15f0b8b01 req-844b9d61-fd82-46a7-846a-0bbe2dd86f43 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received unexpected event network-vif-unplugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 for instance with vm_state active and task_state rescuing.
Jul 31 12:29:14 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Instance destroyed successfully.
Jul 31 12:29:14 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Attempting a stable device rescue
Jul 31 12:29:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72447) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 12:29:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Instance directory exists: not creating {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 12:29:14 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Creating image(s)
Jul 31 12:29:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "/opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "/opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:14 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:29:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "0d38eb98fd387443f1fbc5cfb92971504072d322" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "0d38eb98fd387443f1fbc5cfb92971504072d322" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322.part --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322.part --force-share --output=json" returned: 0 in 0.161s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:15 user nova-compute[72447]: DEBUG nova.virt.images [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] bd36f400-730c-4c14-af71-804fa68008d5 was qcow2, converting to raw {{(pid=72447) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 12:29:15 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:29:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322.part /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322.converted {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.compute.manager [req-65cb2e15-d4b3-4290-b765-ff120d264323 req-608b34ec-b361-4377-86b9-1b18cbb7d955 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-65cb2e15-d4b3-4290-b765-ff120d264323 req-608b34ec-b361-4377-86b9-1b18cbb7d955 service nova] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-65cb2e15-d4b3-4290-b765-ff120d264323 req-608b34ec-b361-4377-86b9-1b18cbb7d955 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-65cb2e15-d4b3-4290-b765-ff120d264323 req-608b34ec-b361-4377-86b9-1b18cbb7d955 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.compute.manager [req-65cb2e15-d4b3-4290-b765-ff120d264323 req-608b34ec-b361-4377-86b9-1b18cbb7d955 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] No waiting events found dispatching network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:29:16 user nova-compute[72447]: WARNING nova.compute.manager [req-65cb2e15-d4b3-4290-b765-ff120d264323 req-608b34ec-b361-4377-86b9-1b18cbb7d955 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received unexpected event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 for instance with vm_state active and task_state rescuing.
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322.part /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322.converted" returned: 0 in 0.553s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322.converted --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "0d38eb98fd387443f1fbc5cfb92971504072d322" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.192s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "0d38eb98fd387443f1fbc5cfb92971504072d322" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "0d38eb98fd387443f1fbc5cfb92971504072d322" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322 --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322 --force-share --output=json" returned: 0 in 0.163s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322,backing_fmt=raw /opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/disk.rescue {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322,backing_fmt=raw /opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/disk.rescue" returned: 0 in 0.050s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "0d38eb98fd387443f1fbc5cfb92971504072d322" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'migration_context' on Instance uuid 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Start _get_guest_xml network_info=[{"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "vif_mac": "fa:16:3e:23:9c:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bd36f400-730c-4c14-af71-804fa68008d5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '760b2421-91a0-4245-b545-70810fcbdb23', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRHOtSTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0', 'attached_at': '', 'detached_at': '', 'volume_id': '95a5aa38-dc89-4b03-ac50-f5fba0e7b7df', 'serial': '95a5aa38-dc89-4b03-ac50-f5fba0e7b7df'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'resources' on Instance uuid 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:29:16 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:29:16 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRHOtSTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:29:16 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:29:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:29:16 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:29:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:29:16 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2e66e1-83c6-4211-8502-d6957335079e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZRHOtSTc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 31 12:29:16 user nova-compute[72447]: node.name = iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df
Jul 31 12:29:16 user nova-compute[72447]: node.tpgt = -1
Jul 31 12:29:16 user nova-compute[72447]: node.startup = automatic
Jul 31 12:29:16 user nova-compute[72447]: node.leading_login = No
Jul 31 12:29:16 user nova-compute[72447]: iface.iscsi_ifacename = default
Jul 31 12:29:16 user nova-compute[72447]: iface.net_ifacename = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.ipaddress = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.prefix_len = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.hwaddress = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.transport_name = tcp
Jul 31 12:29:16 user nova-compute[72447]: iface.initiatorname = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.state = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.vlan_id = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.vlan_priority = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.vlan_state = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.iface_num = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.mtu = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.port = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.bootproto = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.subnet_mask = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.gateway = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.dhcp_alt_client_id_state = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.dhcp_alt_client_id = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.dhcp_dns = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.dhcp_learn_iqn = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.dhcp_req_vendor_id_state = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.dhcp_vendor_id_state = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.dhcp_vendor_id = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.dhcp_slp_da = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.fragmentation = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.gratuitous_arp = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.incoming_forwarding = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.tos_state = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.tos = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.ttl = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.delayed_ack = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.tcp_nagle = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.tcp_wsf_state = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.tcp_wsf = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.tcp_timer_scale = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.tcp_timestamp = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.redirect = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.def_task_mgmt_timeout = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.header_digest = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.data_digest = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.immediate_data = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.initial_r2t = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.data_seq_inorder = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.data_pdu_inorder = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.erl = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.max_receive_data_len = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.first_burst_len = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.max_outstanding_r2t = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.max_burst_len = 0
Jul 31 12:29:16 user nova-compute[72447]: iface.chap_auth = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.bidi_chap = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.strict_login_compliance = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.discovery_auth = <empty>
Jul 31 12:29:16 user nova-compute[72447]: iface.discovery_logout = <empty>
Jul 31 12:29:16 user nova-compute[72447]: node.discovery_address = <empty>
Jul 31 12:29:16 user nova-compute[72447]: node.discovery_port = 0
Jul 31 12:29:16 user nova-compute[72447]: node.discovery_type = static
Jul 31 12:29:16 user nova-compute[72447]: node.session.initial_cmdsn = 0
Jul 31 12:29:16 user nova-compute[72447]: node.session.initial_login_retry_max = 8
Jul 31 12:29:16 user nova-compute[72447]: node.session.xmit_thread_priority = -20
Jul 31 12:29:16 user nova-compute[72447]: node.session.cmds_max = 128
Jul 31 12:29:16 user nova-compute[72447]: node.session.queue_depth = 32
Jul 31 12:29:16 user nova-compute[72447]: node.session.nr_sessions = 1
Jul 31 12:29:16 user nova-compute[72447]: node.session.auth.authmethod = CHAP
Jul 31 12:29:16 user nova-compute[72447]: node.session.auth.username = ZRHOtSTc
Jul 31 12:29:16 user nova-compute[72447]: node.session.auth.password = ***
Jul 31 12:29:16 user nova-compute[72447]: node.session.auth.username_in = <empty>
Jul 31 12:29:16 user nova-compute[72447]: node.session.auth.password_in = <empty>
Jul 31 12:29:16 user nova-compute[72447]: node.session.auth.chap_algs = MD5
Jul 31 12:29:16 user nova-compute[72447]: node.session.timeo.replacement_timeout = 120
Jul 31 12:29:16 user nova-compute[72447]: node.session.err_timeo.abort_timeout = 15
Jul 31 12:29:16 user nova-compute[72447]: node.session.err_timeo.lu_reset_timeout = 30
Jul 31 12:29:16 user nova-compute[72447]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 31 12:29:16 user nova-compute[72447]: node.session.err_timeo.host_reset_timeout = 60
Jul 31 12:29:16 user nova-compute[72447]: node.session.iscsi.FastAbort = Yes
Jul 31 12:29:16 user nova-compute[72447]: node.session.iscsi.InitialR2T = No
Jul 31 12:29:16 user nova-compute[72447]: node.session.iscsi.ImmediateData = Yes
Jul 31 12:29:16 user nova-compute[72447]: node.session.iscsi.FirstBurstLength = 262144
Jul 31 12:29:16 user nova-compute[72447]: node.session.iscsi.MaxBurstLength = 16776192
Jul 31 12:29:16 user nova-compute[72447]: node.session.iscsi.DefaultTime2Retain = 0
Jul 31 12:29:16 user nova-compute[72447]: node.session.iscsi.DefaultTime2Wait = 2
Jul 31 12:29:16 user nova-compute[72447]: node.session.iscsi.MaxConnections = 1
Jul 31 12:29:16 user nova-compute[72447]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 31 12:29:16 user nova-compute[72447]: node.session.iscsi.ERL = 0
Jul 31 12:29:16 user nova-compute[72447]: node.session.scan = manual
Jul 31 12:29:16 user nova-compute[72447]: node.session.reopen_max = 0
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].address = 172.16.0.220
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].port = 3260
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].startup = manual
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].tcp.window_size = 524288
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].tcp.type_of_service = 0
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].timeo.logout_timeout = 15
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].timeo.login_timeout = 15
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].timeo.auth_timeout = 45
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].timeo.noop_out_interval = 5
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].timeo.noop_out_timeout = 5
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].iscsi.HeaderDigest = None
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].iscsi.DataDigest = None
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].iscsi.IFMarker = No
Jul 31 12:29:16 user nova-compute[72447]: node.conn[0].iscsi.OFMarker = No
Jul 31 12:29:16 user nova-compute[72447]: # END RECORD
Jul 31 12:29:16 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8856e9f3-dd3c-4980-9bb6-499e22903312]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7b60bb-35de-4354-971d-4a4b7a884dc3]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRHOtSTc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRHOtSTc" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfd12c0-ca88-4b07-891e-ff076d118763]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZRHOtSTc'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f842ac77-5501-4103-b318-40f4c70ba226]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d404413c-cebb-4684-a5b6-98849d6d88fc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:29:17 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:29:17 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:29:17 user nova-compute[72447]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 (non-flash)
Jul 31 12:29:17 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:29:17 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:29:17 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:29:17 user nova-compute[72447]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 (non-flash)
Jul 31 12:29:17 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.170s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] HCTL ('35', '0', '0', 0) found on session 37 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6115974a-7cd2-46a1-9ce9-083dc6b40376]: (4, ('0 0 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Searching for a device in session 37 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRHOtSTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23130643234303034', 'path': '/dev/sdd'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130643234303034', 'path': '/dev/sdd'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1891158354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1891158354',id=37,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:27:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-3c0dkf4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:27:54Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "vif_mac": "fa:16:3e:23:9c:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "vif_mac": "fa:16:3e:23:9c:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:9c:86,bridge_name='br-int',has_traffic_filtering=True,id=82f2076d-509b-45d4-9ef3-cfc546e01a85,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f2076d-50') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG nova.objects.instance [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:29:17 user nova-compute[72447]:   <uuid>6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0</uuid>
Jul 31 12:29:17 user nova-compute[72447]:   <name>instance-00000025</name>
Jul 31 12:29:17 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:29:17 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:29:17 user nova-compute[72447]:   <metadata>
Jul 31 12:29:17 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:29:17 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:29:17 user nova-compute[72447]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1891158354</nova:name>
Jul 31 12:29:17 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:29:16</nova:creationTime>
Jul 31 12:29:17 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:29:17 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:29:17 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:29:17 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:29:17 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:29:17 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:29:17 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:29:17 user nova-compute[72447]:       <nova:owner>
Jul 31 12:29:17 user nova-compute[72447]:         <nova:user uuid="33268392189342ecbca53c9ad959245e">tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member</nova:user>
Jul 31 12:29:17 user nova-compute[72447]:         <nova:project uuid="a055fae579aa4858867824625e8bd18d">tempest-ServerBootFromVolumeStableRescueTest-1637857313</nova:project>
Jul 31 12:29:17 user nova-compute[72447]:       </nova:owner>
Jul 31 12:29:17 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:29:17 user nova-compute[72447]:       <nova:ports>
Jul 31 12:29:17 user nova-compute[72447]:         <nova:port uuid="82f2076d-509b-45d4-9ef3-cfc546e01a85">
Jul 31 12:29:17 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 12:29:17 user nova-compute[72447]:         </nova:port>
Jul 31 12:29:17 user nova-compute[72447]:       </nova:ports>
Jul 31 12:29:17 user nova-compute[72447]:     </nova:instance>
Jul 31 12:29:17 user nova-compute[72447]:   </metadata>
Jul 31 12:29:17 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:29:17 user nova-compute[72447]:     <system>
Jul 31 12:29:17 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:29:17 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:29:17 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:29:17 user nova-compute[72447]:       <entry name="serial">6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0</entry>
Jul 31 12:29:17 user nova-compute[72447]:       <entry name="uuid">6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0</entry>
Jul 31 12:29:17 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:29:17 user nova-compute[72447]:     </system>
Jul 31 12:29:17 user nova-compute[72447]:   </sysinfo>
Jul 31 12:29:17 user nova-compute[72447]:   <os>
Jul 31 12:29:17 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:29:17 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:29:17 user nova-compute[72447]:   </os>
Jul 31 12:29:17 user nova-compute[72447]:   <features>
Jul 31 12:29:17 user nova-compute[72447]:     <acpi/>
Jul 31 12:29:17 user nova-compute[72447]:     <apic/>
Jul 31 12:29:17 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:29:17 user nova-compute[72447]:   </features>
Jul 31 12:29:17 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:29:17 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:29:17 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:29:17 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:29:17 user nova-compute[72447]:   </clock>
Jul 31 12:29:17 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:29:17 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:29:17 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:29:17 user nova-compute[72447]:   </cpu>
Jul 31 12:29:17 user nova-compute[72447]:   <devices>
Jul 31 12:29:17 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:29:17 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:29:17 user nova-compute[72447]:       <source dev="/dev/sdd"/>
Jul 31 12:29:17 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:29:17 user nova-compute[72447]:       <serial>95a5aa38-dc89-4b03-ac50-f5fba0e7b7df</serial>
Jul 31 12:29:17 user nova-compute[72447]:     </disk>
Jul 31 12:29:17 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:29:17 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:29:17 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/disk.rescue"/>
Jul 31 12:29:17 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:29:17 user nova-compute[72447]:       <boot order="1"/>
Jul 31 12:29:17 user nova-compute[72447]:     </disk>
Jul 31 12:29:17 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:29:17 user nova-compute[72447]:       <mac address="fa:16:3e:23:9c:86"/>
Jul 31 12:29:17 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:29:17 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:29:17 user nova-compute[72447]:       <target dev="tap82f2076d-50"/>
Jul 31 12:29:17 user nova-compute[72447]:     </interface>
Jul 31 12:29:17 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:29:17 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/console.log" append="off"/>
Jul 31 12:29:17 user nova-compute[72447]:     </serial>
Jul 31 12:29:17 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:29:17 user nova-compute[72447]:     <video>
Jul 31 12:29:17 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:29:17 user nova-compute[72447]:     </video>
Jul 31 12:29:17 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:29:17 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:29:17 user nova-compute[72447]:     </rng>
Jul 31 12:29:17 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:29:17 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:29:17 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:29:17 user nova-compute[72447]:     </memballoon>
Jul 31 12:29:17 user nova-compute[72447]:   </devices>
Jul 31 12:29:17 user nova-compute[72447]: </domain>
Jul 31 12:29:17 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:29:17 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Instance destroyed successfully.
Jul 31 12:29:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:29:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] No VIF found with MAC fa:16:3e:23:9c:86, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:29:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-3377bff8-a97a-4837-aeac-0686f2eb5aa3 req-7b4c9ce1-c9c8-4937-9f2f-5bc93d1ec254 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3377bff8-a97a-4837-aeac-0686f2eb5aa3 req-7b4c9ce1-c9c8-4937-9f2f-5bc93d1ec254 service nova] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3377bff8-a97a-4837-aeac-0686f2eb5aa3 req-7b4c9ce1-c9c8-4937-9f2f-5bc93d1ec254 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3377bff8-a97a-4837-aeac-0686f2eb5aa3 req-7b4c9ce1-c9c8-4937-9f2f-5bc93d1ec254 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-3377bff8-a97a-4837-aeac-0686f2eb5aa3 req-7b4c9ce1-c9c8-4937-9f2f-5bc93d1ec254 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] No waiting events found dispatching network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:29:19 user nova-compute[72447]: WARNING nova.compute.manager [req-3377bff8-a97a-4837-aeac-0686f2eb5aa3 req-7b4c9ce1-c9c8-4937-9f2f-5bc93d1ec254 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received unexpected event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 for instance with vm_state active and task_state rescuing.
Jul 31 12:29:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:29:21 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806561.0459988, 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:29:21 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] VM Resumed (Lifecycle Event)
Jul 31 12:29:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6af2a8ec-3c7b-4543-bead-ed7109f050ee tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:29:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:29:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:29:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-98e6b48e-841f-4f1b-a469-8958bbbe7a69 req-c3046fbe-23e1-4698-9423-d69ecdcbcedd service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-98e6b48e-841f-4f1b-a469-8958bbbe7a69 req-c3046fbe-23e1-4698-9423-d69ecdcbcedd service nova] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-98e6b48e-841f-4f1b-a469-8958bbbe7a69 req-c3046fbe-23e1-4698-9423-d69ecdcbcedd service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-98e6b48e-841f-4f1b-a469-8958bbbe7a69 req-c3046fbe-23e1-4698-9423-d69ecdcbcedd service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:21 user nova-compute[72447]: DEBUG nova.compute.manager [req-98e6b48e-841f-4f1b-a469-8958bbbe7a69 req-c3046fbe-23e1-4698-9423-d69ecdcbcedd service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] No waiting events found dispatching network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:29:21 user nova-compute[72447]: WARNING nova.compute.manager [req-98e6b48e-841f-4f1b-a469-8958bbbe7a69 req-c3046fbe-23e1-4698-9423-d69ecdcbcedd service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received unexpected event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 for instance with vm_state active and task_state rescuing.
Jul 31 12:29:21 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 12:29:21 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806561.050239, 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:29:21 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] VM Started (Lifecycle Event)
Jul 31 12:29:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:29:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:29:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:25 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806550.2750723, 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:29:25 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] VM Stopped (Lifecycle Event)
Jul 31 12:29:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4a7d1352-72ce-48e9-997f-8039996be44d None None] [instance: 36b623bd-370d-4cb5-81e6-0ee3d20ed8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:29:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "cf664b3e-d48f-45d1-b47e-53e81c769054" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:44 user nova-compute[72447]: INFO nova.compute.manager [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Detaching volume ca47d9c0-60a5-48ba-9415-c080e569e287
Jul 31 12:29:44 user nova-compute[72447]: INFO nova.virt.block_device [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Attempting to driver detach volume ca47d9c0-60a5-48ba-9415-c080e569e287 from mountpoint /dev/vdb
Jul 31 12:29:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Attempting to detach device vdb from instance cf664b3e-d48f-45d1-b47e-53e81c769054 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:29:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:29:44 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:29:44 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:29:44 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:29:44 user nova-compute[72447]:   <serial>ca47d9c0-60a5-48ba-9415-c080e569e287</serial>
Jul 31 12:29:44 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:29:44 user nova-compute[72447]: </disk>
Jul 31 12:29:44 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:29:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Successfully detached device vdb from instance cf664b3e-d48f-45d1-b47e-53e81c769054 from the persistent domain config.
Jul 31 12:29:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf664b3e-d48f-45d1-b47e-53e81c769054 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:29:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:29:44 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:29:44 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:29:44 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:29:44 user nova-compute[72447]:   <serial>ca47d9c0-60a5-48ba-9415-c080e569e287</serial>
Jul 31 12:29:44 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:29:44 user nova-compute[72447]: </disk>
Jul 31 12:29:44 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:29:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "cf664b3e-d48f-45d1-b47e-53e81c769054" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806585.3062825, cf664b3e-d48f-45d1-b47e-53e81c769054 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf664b3e-d48f-45d1-b47e-53e81c769054 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:29:45 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Successfully detached device vdb from instance cf664b3e-d48f-45d1-b47e-53e81c769054 from the live domain config.
Jul 31 12:29:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYZHztgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:29:45 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e579b4-e5e1-4c36-9c64-9475b602bfd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39c0e83-cb25-4e3f-b140-3df1662e1f3f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:29:45 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:29:45 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:29:45 user nova-compute[72447]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 (non-flash)
Jul 31 12:29:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:29:45 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:29:45 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:29:45 user nova-compute[72447]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 (non-flash)
Jul 31 12:29:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06682e5750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287'): ({'sde'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Removing single pathed devices sde {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ab38c6-592d-4dbf-a9cf-6c8d41aa7aa2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba338bf2-c521-4a8d-bd23-578f6a6d0935]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Flushing IO for device /dev/sde {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1251d048-3042-45fc-987d-d7411f541f8f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.230s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[60187c19-c9be-4a70-b43e-8477e7393f3d]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.087s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8db042-cdbd-4f13-bfee-59787d18171c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a7541f-53ed-417a-ab9a-f9656d15925c]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287, portal: 172.16.0.220,3260]
Jul 31 12:29:45 user nova-compute[72447]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287, portal: 172.16.0.220,3260] successful.
Jul 31 12:29:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b4c1c9-5f27-4d3d-99b9-c317077885f0]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.573s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] <== disconnect_volume: return (574ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:29:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:29:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG nova.objects.instance [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lazy-loading 'flavor' on Instance uuid cf664b3e-d48f-45d1-b47e-53e81c769054 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-58d5a62f-34e8-4d36-ac15-b8a78f021379 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.404s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 9.277s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:54 user nova-compute[72447]: INFO nova.compute.manager [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Terminating instance
Jul 31 12:29:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-56bb29af-7107-405f-a618-516cb270c4be req-4b15e9cf-702f-424b-a2c9-d25b37bdd318 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Received event network-vif-unplugged-e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-56bb29af-7107-405f-a618-516cb270c4be req-4b15e9cf-702f-424b-a2c9-d25b37bdd318 service nova] Acquiring lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-56bb29af-7107-405f-a618-516cb270c4be req-4b15e9cf-702f-424b-a2c9-d25b37bdd318 service nova] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-56bb29af-7107-405f-a618-516cb270c4be req-4b15e9cf-702f-424b-a2c9-d25b37bdd318 service nova] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-56bb29af-7107-405f-a618-516cb270c4be req-4b15e9cf-702f-424b-a2c9-d25b37bdd318 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] No waiting events found dispatching network-vif-unplugged-e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-56bb29af-7107-405f-a618-516cb270c4be req-4b15e9cf-702f-424b-a2c9-d25b37bdd318 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Received event network-vif-unplugged-e553a5d8-d071-4c12-995b-74d2cf9d343c for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:29:54 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Instance destroyed successfully.
Jul 31 12:29:54 user nova-compute[72447]: DEBUG nova.objects.instance [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lazy-loading 'resources' on Instance uuid cf664b3e-d48f-45d1-b47e-53e81c769054 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1509750683',display_name='tempest-VolumesSnapshotTestJSON-instance-1509750683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1509750683',id=35,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+xTS03T73IadZ7tuAOTDBd5Y4FbmE353IOrcxkqMBJUtjwsCpLOP6BPq4Jga+T2/qOUlMblkYjATbft8IbmP0NVDI848Wb4sy50gfCljOVIG7HT8ZFA+tojOC2es88mA==',key_name='tempest-keypair-1039769747',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c46c90a8c1f42aeb9e63db6aa240ab5',ramdisk_id='',reservation_id='r-ptnii213',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1298774726',owner_user_name='tempest-VolumesSnapshotTestJSON-1298774726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9517e4295d8c4e22a09e193f9687811c',uuid=cf664b3e-d48f-45d1-b47e-53e81c769054,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "address": "fa:16:3e:0c:f8:c3", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape553a5d8-d0", "ovs_interfaceid": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Converting VIF {"id": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "address": "fa:16:3e:0c:f8:c3", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape553a5d8-d0", "ovs_interfaceid": "e553a5d8-d071-4c12-995b-74d2cf9d343c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f8:c3,bridge_name='br-int',has_traffic_filtering=True,id=e553a5d8-d071-4c12-995b-74d2cf9d343c,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape553a5d8-d0') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG os_vif [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f8:c3,bridge_name='br-int',has_traffic_filtering=True,id=e553a5d8-d071-4c12-995b-74d2cf9d343c,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape553a5d8-d0') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape553a5d8-d0, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:54 user nova-compute[72447]: INFO os_vif [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f8:c3,bridge_name='br-int',has_traffic_filtering=True,id=e553a5d8-d071-4c12-995b-74d2cf9d343c,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape553a5d8-d0')
Jul 31 12:29:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYZHztgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:29:54 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:29:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca47d9c0-60a5-48ba-9415-c080e569e287', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e4d36f-8e17-4041-be72-5881733175d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[564f3fe9-720a-4844-b15e-be8f3d32bc85]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:29:54 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:29:54 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:29:54 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:29:54 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:29:54 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:29:54 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06682e6320>, {}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Disconnecting from: [] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.060s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] <== disconnect_volume: return (61ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:29:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:29:54 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Deleting instance files /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054_del
Jul 31 12:29:54 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Deletion of /opt/stack/data/nova/instances/cf664b3e-d48f-45d1-b47e-53e81c769054_del complete
Jul 31 12:29:55 user nova-compute[72447]: INFO nova.compute.manager [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Took 0.97 seconds to destroy the instance on the hypervisor.
Jul 31 12:29:55 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:29:55 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:29:55 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:29:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:56 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:29:56 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Took 1.52 seconds to deallocate network for instance.
Jul 31 12:29:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-38b90247-03ba-4b68-a586-a3e098bf3257 req-20c3da1d-1fb7-41cc-ab70-e74d7f6ff9bb service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Received event network-vif-plugged-e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-38b90247-03ba-4b68-a586-a3e098bf3257 req-20c3da1d-1fb7-41cc-ab70-e74d7f6ff9bb service nova] Acquiring lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-38b90247-03ba-4b68-a586-a3e098bf3257 req-20c3da1d-1fb7-41cc-ab70-e74d7f6ff9bb service nova] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-38b90247-03ba-4b68-a586-a3e098bf3257 req-20c3da1d-1fb7-41cc-ab70-e74d7f6ff9bb service nova] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-38b90247-03ba-4b68-a586-a3e098bf3257 req-20c3da1d-1fb7-41cc-ab70-e74d7f6ff9bb service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] No waiting events found dispatching network-vif-plugged-e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:29:56 user nova-compute[72447]: WARNING nova.compute.manager [req-38b90247-03ba-4b68-a586-a3e098bf3257 req-20c3da1d-1fb7-41cc-ab70-e74d7f6ff9bb service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Received unexpected event network-vif-plugged-e553a5d8-d071-4c12-995b-74d2cf9d343c for instance with vm_state active and task_state deleting.
Jul 31 12:29:56 user nova-compute[72447]: WARNING nova.volume.cinder [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Attachment 800f740e-2970-445a-b63b-72fe14f00cd4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 800f740e-2970-445a-b63b-72fe14f00cd4. (HTTP 404) (Request-ID: req-9db36d59-4a30-49a4-a537-656762cd6f36)
Jul 31 12:29:56 user nova-compute[72447]: INFO nova.compute.manager [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Took 0.05 seconds to detach 1 volumes for instance.
Jul 31 12:29:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:29:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:29:56 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:29:57 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:29:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:57 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Deleted allocations for instance cf664b3e-d48f-45d1-b47e-53e81c769054
Jul 31 12:29:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ba82f5cf-20bf-46c2-bacb-9fd0a5899cca tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "cf664b3e-d48f-45d1-b47e-53e81c769054" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.137s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:29:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:58 user nova-compute[72447]: DEBUG nova.compute.manager [req-bfd51a46-4883-4ecb-a805-33219a836249 req-be05e9e4-67e4-4d83-8496-9170a269b045 service nova] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Received event network-vif-deleted-e553a5d8-d071-4c12-995b-74d2cf9d343c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:29:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:29:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:01 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:30:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:30:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:30:02 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:30:02 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:30:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:30:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:30:02 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:30:02 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid 51e36718-ed91-4dc5-82db-1f429df14d2f {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:30:02 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Updating instance_info_cache with network_info: [{"id": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "address": "fa:16:3e:4e:fc:4a", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a18de-e6", "ovs_interfaceid": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:30:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-51e36718-ed91-4dc5-82db-1f429df14d2f" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:30:02 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:30:04 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:30:04 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:30:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:30:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:05 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/disk.rescue --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:08 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:30:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:30:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:09 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806594.8603086, cf664b3e-d48f-45d1-b47e-53e81c769054 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:30:09 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] VM Stopped (Lifecycle Event)
Jul 31 12:30:10 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:30:10 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7596MB free_disk=24.998363494873047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.manager [None req-63e7641e-76be-40ff-a687-5bd5063c40ff None None] [instance: cf664b3e-d48f-45d1-b47e-53e81c769054] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance f3f1534b-16c0-4dee-b78c-d53713113a64 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2a481721-232b-4a4d-83ad-cfbac144bb5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:30:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:30:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:11 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:30:11 user nova-compute[72447]: INFO nova.compute.claims [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Claim successful on node user
Jul 31 12:30:11 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:30:11 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:30:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:30:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:30:11 user nova-compute[72447]: DEBUG nova.network.neutron [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:30:12 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:30:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG nova.policy [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc3c158bb86b454b8527d84833be1543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c6b4b34cf749a488dc865c1662a22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:30:12 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Creating image(s)
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "/opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "/opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "/opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.145s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.159s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk 1073741824" returned: 0 in 0.064s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG nova.network.neutron [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Successfully created port: 5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Cannot resize image /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG nova.objects.instance [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lazy-loading 'migration_context' on Instance uuid 48e13eb4-f1e9-415d-8167-1ab683d1680e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Ensure instance console log exists: /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:13 user nova-compute[72447]: DEBUG nova.network.neutron [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Successfully updated port: 5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:30:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "refresh_cache-48e13eb4-f1e9-415d-8167-1ab683d1680e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:30:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquired lock "refresh_cache-48e13eb4-f1e9-415d-8167-1ab683d1680e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:30:13 user nova-compute[72447]: DEBUG nova.network.neutron [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:30:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-3084d291-d15e-460c-bdfd-233694fc7b2e req-55c3d811-68d9-4fb6-8e65-18f56ccf02a5 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Received event network-changed-5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:30:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-3084d291-d15e-460c-bdfd-233694fc7b2e req-55c3d811-68d9-4fb6-8e65-18f56ccf02a5 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Refreshing instance network info cache due to event network-changed-5b8d4302-80bf-4360-bb21-2e287c5732dd. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:30:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3084d291-d15e-460c-bdfd-233694fc7b2e req-55c3d811-68d9-4fb6-8e65-18f56ccf02a5 service nova] Acquiring lock "refresh_cache-48e13eb4-f1e9-415d-8167-1ab683d1680e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:30:13 user nova-compute[72447]: DEBUG nova.network.neutron [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.network.neutron [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Updating instance_info_cache with network_info: [{"id": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "address": "fa:16:3e:63:69:0e", "network": {"id": "f7ca946a-7d88-4acb-ba32-111edd4250db", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264876345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33c6b4b34cf749a488dc865c1662a22e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8d4302-80", "ovs_interfaceid": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Releasing lock "refresh_cache-48e13eb4-f1e9-415d-8167-1ab683d1680e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Instance network_info: |[{"id": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "address": "fa:16:3e:63:69:0e", "network": {"id": "f7ca946a-7d88-4acb-ba32-111edd4250db", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264876345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33c6b4b34cf749a488dc865c1662a22e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8d4302-80", "ovs_interfaceid": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3084d291-d15e-460c-bdfd-233694fc7b2e req-55c3d811-68d9-4fb6-8e65-18f56ccf02a5 service nova] Acquired lock "refresh_cache-48e13eb4-f1e9-415d-8167-1ab683d1680e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.network.neutron [req-3084d291-d15e-460c-bdfd-233694fc7b2e req-55c3d811-68d9-4fb6-8e65-18f56ccf02a5 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Refreshing network info cache for port 5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Start _get_guest_xml network_info=[{"id": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "address": "fa:16:3e:63:69:0e", "network": {"id": "f7ca946a-7d88-4acb-ba32-111edd4250db", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264876345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33c6b4b34cf749a488dc865c1662a22e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8d4302-80", "ovs_interfaceid": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:30:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:30:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-275536995',display_name='tempest-TestServerVolumeAttachmentScenario-server-275536995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-275536995',id=40,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERdFp3IwQsn0gm2XPX9RAumGxoj9l8onrUabTv2bpWWcBE69DeTMoqorGduCX3oCDm/LozqXYCji2oyAavMRnAKWnnX510wT6CT0dOFlPBpUDrVnEbSws55un7qnDoXrg==',key_name='tempest-keypair-314356135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33c6b4b34cf749a488dc865c1662a22e',ramdisk_id='',reservation_id='r-wmu8gnu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1068509389',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1068509389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc3c158bb86b454b8527d84833be1543',uuid=48e13eb4-f1e9-415d-8167-1ab683d1680e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "address": "fa:16:3e:63:69:0e", "network": {"id": "f7ca946a-7d88-4acb-ba32-111edd4250db", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264876345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33c6b4b34cf749a488dc865c1662a22e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8d4302-80", "ovs_interfaceid": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Converting VIF {"id": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "address": "fa:16:3e:63:69:0e", "network": {"id": "f7ca946a-7d88-4acb-ba32-111edd4250db", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264876345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33c6b4b34cf749a488dc865c1662a22e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8d4302-80", "ovs_interfaceid": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:69:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b8d4302-80bf-4360-bb21-2e287c5732dd,network=Network(f7ca946a-7d88-4acb-ba32-111edd4250db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8d4302-80') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.objects.instance [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lazy-loading 'pci_devices' on Instance uuid 48e13eb4-f1e9-415d-8167-1ab683d1680e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:30:14 user nova-compute[72447]:   <uuid>48e13eb4-f1e9-415d-8167-1ab683d1680e</uuid>
Jul 31 12:30:14 user nova-compute[72447]:   <name>instance-00000028</name>
Jul 31 12:30:14 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:30:14 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:30:14 user nova-compute[72447]:   <metadata>
Jul 31 12:30:14 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:30:14 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:30:14 user nova-compute[72447]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-275536995</nova:name>
Jul 31 12:30:14 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:30:14</nova:creationTime>
Jul 31 12:30:14 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:30:14 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:30:14 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:30:14 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:30:14 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:30:14 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:30:14 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:30:14 user nova-compute[72447]:       <nova:owner>
Jul 31 12:30:14 user nova-compute[72447]:         <nova:user uuid="dc3c158bb86b454b8527d84833be1543">tempest-TestServerVolumeAttachmentScenario-1068509389-project-member</nova:user>
Jul 31 12:30:14 user nova-compute[72447]:         <nova:project uuid="33c6b4b34cf749a488dc865c1662a22e">tempest-TestServerVolumeAttachmentScenario-1068509389</nova:project>
Jul 31 12:30:14 user nova-compute[72447]:       </nova:owner>
Jul 31 12:30:14 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:30:14 user nova-compute[72447]:       <nova:ports>
Jul 31 12:30:14 user nova-compute[72447]:         <nova:port uuid="5b8d4302-80bf-4360-bb21-2e287c5732dd">
Jul 31 12:30:14 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 12:30:14 user nova-compute[72447]:         </nova:port>
Jul 31 12:30:14 user nova-compute[72447]:       </nova:ports>
Jul 31 12:30:14 user nova-compute[72447]:     </nova:instance>
Jul 31 12:30:14 user nova-compute[72447]:   </metadata>
Jul 31 12:30:14 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:30:14 user nova-compute[72447]:     <system>
Jul 31 12:30:14 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:30:14 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:30:14 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:30:14 user nova-compute[72447]:       <entry name="serial">48e13eb4-f1e9-415d-8167-1ab683d1680e</entry>
Jul 31 12:30:14 user nova-compute[72447]:       <entry name="uuid">48e13eb4-f1e9-415d-8167-1ab683d1680e</entry>
Jul 31 12:30:14 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:30:14 user nova-compute[72447]:     </system>
Jul 31 12:30:14 user nova-compute[72447]:   </sysinfo>
Jul 31 12:30:14 user nova-compute[72447]:   <os>
Jul 31 12:30:14 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:30:14 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:30:14 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:30:14 user nova-compute[72447]:   </os>
Jul 31 12:30:14 user nova-compute[72447]:   <features>
Jul 31 12:30:14 user nova-compute[72447]:     <acpi/>
Jul 31 12:30:14 user nova-compute[72447]:     <apic/>
Jul 31 12:30:14 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:30:14 user nova-compute[72447]:   </features>
Jul 31 12:30:14 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:30:14 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:30:14 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:30:14 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:30:14 user nova-compute[72447]:   </clock>
Jul 31 12:30:14 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:30:14 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:30:14 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:30:14 user nova-compute[72447]:   </cpu>
Jul 31 12:30:14 user nova-compute[72447]:   <devices>
Jul 31 12:30:14 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:30:14 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:30:14 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk"/>
Jul 31 12:30:14 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:30:14 user nova-compute[72447]:     </disk>
Jul 31 12:30:14 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:30:14 user nova-compute[72447]:       <mac address="fa:16:3e:63:69:0e"/>
Jul 31 12:30:14 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:30:14 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:30:14 user nova-compute[72447]:       <target dev="tap5b8d4302-80"/>
Jul 31 12:30:14 user nova-compute[72447]:     </interface>
Jul 31 12:30:14 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:30:14 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/console.log" append="off"/>
Jul 31 12:30:14 user nova-compute[72447]:     </serial>
Jul 31 12:30:14 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:30:14 user nova-compute[72447]:     <video>
Jul 31 12:30:14 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:30:14 user nova-compute[72447]:     </video>
Jul 31 12:30:14 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:30:14 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:30:14 user nova-compute[72447]:     </rng>
Jul 31 12:30:14 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:30:14 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:30:14 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:30:14 user nova-compute[72447]:     </memballoon>
Jul 31 12:30:14 user nova-compute[72447]:   </devices>
Jul 31 12:30:14 user nova-compute[72447]: </domain>
Jul 31 12:30:14 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-275536995',display_name='tempest-TestServerVolumeAttachmentScenario-server-275536995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-275536995',id=40,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERdFp3IwQsn0gm2XPX9RAumGxoj9l8onrUabTv2bpWWcBE69DeTMoqorGduCX3oCDm/LozqXYCji2oyAavMRnAKWnnX510wT6CT0dOFlPBpUDrVnEbSws55un7qnDoXrg==',key_name='tempest-keypair-314356135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33c6b4b34cf749a488dc865c1662a22e',ramdisk_id='',reservation_id='r-wmu8gnu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1068509389',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1068509389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc3c158bb86b454b8527d84833be1543',uuid=48e13eb4-f1e9-415d-8167-1ab683d1680e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "address": "fa:16:3e:63:69:0e", "network": {"id": "f7ca946a-7d88-4acb-ba32-111edd4250db", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264876345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33c6b4b34cf749a488dc865c1662a22e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8d4302-80", "ovs_interfaceid": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Converting VIF {"id": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "address": "fa:16:3e:63:69:0e", "network": {"id": "f7ca946a-7d88-4acb-ba32-111edd4250db", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264876345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33c6b4b34cf749a488dc865c1662a22e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8d4302-80", "ovs_interfaceid": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:69:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b8d4302-80bf-4360-bb21-2e287c5732dd,network=Network(f7ca946a-7d88-4acb-ba32-111edd4250db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8d4302-80') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG os_vif [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:69:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b8d4302-80bf-4360-bb21-2e287c5732dd,network=Network(f7ca946a-7d88-4acb-ba32-111edd4250db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8d4302-80') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b8d4302-80, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b8d4302-80, col_values=(('external_ids', {'iface-id': '5b8d4302-80bf-4360-bb21-2e287c5732dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:69:0e', 'vm-uuid': '48e13eb4-f1e9-415d-8167-1ab683d1680e'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:14 user nova-compute[72447]: INFO os_vif [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:69:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b8d4302-80bf-4360-bb21-2e287c5732dd,network=Network(f7ca946a-7d88-4acb-ba32-111edd4250db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8d4302-80')
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] No VIF found with MAC fa:16:3e:63:69:0e, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.network.neutron [req-3084d291-d15e-460c-bdfd-233694fc7b2e req-55c3d811-68d9-4fb6-8e65-18f56ccf02a5 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Updated VIF entry in instance network info cache for port 5b8d4302-80bf-4360-bb21-2e287c5732dd. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG nova.network.neutron [req-3084d291-d15e-460c-bdfd-233694fc7b2e req-55c3d811-68d9-4fb6-8e65-18f56ccf02a5 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Updating instance_info_cache with network_info: [{"id": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "address": "fa:16:3e:63:69:0e", "network": {"id": "f7ca946a-7d88-4acb-ba32-111edd4250db", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264876345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33c6b4b34cf749a488dc865c1662a22e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8d4302-80", "ovs_interfaceid": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:30:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3084d291-d15e-460c-bdfd-233694fc7b2e req-55c3d811-68d9-4fb6-8e65-18f56ccf02a5 service nova] Releasing lock "refresh_cache-48e13eb4-f1e9-415d-8167-1ab683d1680e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:30:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:15 user nova-compute[72447]: DEBUG nova.compute.manager [req-ba36b7ab-529f-466e-862c-90077b3051d7 req-437c862d-8d6c-4f82-82fe-e7ce93795814 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Received event network-vif-plugged-5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:30:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ba36b7ab-529f-466e-862c-90077b3051d7 req-437c862d-8d6c-4f82-82fe-e7ce93795814 service nova] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ba36b7ab-529f-466e-862c-90077b3051d7 req-437c862d-8d6c-4f82-82fe-e7ce93795814 service nova] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ba36b7ab-529f-466e-862c-90077b3051d7 req-437c862d-8d6c-4f82-82fe-e7ce93795814 service nova] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:15 user nova-compute[72447]: DEBUG nova.compute.manager [req-ba36b7ab-529f-466e-862c-90077b3051d7 req-437c862d-8d6c-4f82-82fe-e7ce93795814 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] No waiting events found dispatching network-vif-plugged-5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:30:15 user nova-compute[72447]: WARNING nova.compute.manager [req-ba36b7ab-529f-466e-862c-90077b3051d7 req-437c862d-8d6c-4f82-82fe-e7ce93795814 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Received unexpected event network-vif-plugged-5b8d4302-80bf-4360-bb21-2e287c5732dd for instance with vm_state building and task_state spawning.
Jul 31 12:30:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806617.9017744, 48e13eb4-f1e9-415d-8167-1ab683d1680e => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:30:17 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] VM Resumed (Lifecycle Event)
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-0d96b594-a756-4c0c-a403-599111040c5f req-bfc20c72-9764-41cf-a114-76ec85de7ff5 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Received event network-vif-plugged-5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0d96b594-a756-4c0c-a403-599111040c5f req-bfc20c72-9764-41cf-a114-76ec85de7ff5 service nova] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0d96b594-a756-4c0c-a403-599111040c5f req-bfc20c72-9764-41cf-a114-76ec85de7ff5 service nova] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0d96b594-a756-4c0c-a403-599111040c5f req-bfc20c72-9764-41cf-a114-76ec85de7ff5 service nova] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-0d96b594-a756-4c0c-a403-599111040c5f req-bfc20c72-9764-41cf-a114-76ec85de7ff5 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] No waiting events found dispatching network-vif-plugged-5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:30:17 user nova-compute[72447]: WARNING nova.compute.manager [req-0d96b594-a756-4c0c-a403-599111040c5f req-bfc20c72-9764-41cf-a114-76ec85de7ff5 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Received unexpected event network-vif-plugged-5b8d4302-80bf-4360-bb21-2e287c5732dd for instance with vm_state building and task_state spawning.
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:30:17 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Instance spawned successfully.
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:30:17 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806617.912669, 48e13eb4-f1e9-415d-8167-1ab683d1680e => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:30:17 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] VM Started (Lifecycle Event)
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:30:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:30:18 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:30:18 user nova-compute[72447]: INFO nova.compute.manager [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Took 5.82 seconds to spawn the instance on the hypervisor.
Jul 31 12:30:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:30:18 user nova-compute[72447]: INFO nova.compute.manager [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Took 6.66 seconds to build instance.
Jul 31 12:30:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-33c69cfb-7e32-4136-b3a0-4db36ac1bd4f tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.819s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:30:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:30:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:30:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:30:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:30 user nova-compute[72447]: INFO nova.compute.manager [None req-96c863ce-9b3e-453e-9958-6a0f82fe41d7 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Get console output
Jul 31 12:30:30 user nova-compute[72447]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 31 12:30:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-10b23cc7-cd0a-4cc9-a5bd-e7b1be943cd5 req-87215416-eaa4-47de-97c9-fd3aca9847f2 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Received event network-changed-3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:30:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-10b23cc7-cd0a-4cc9-a5bd-e7b1be943cd5 req-87215416-eaa4-47de-97c9-fd3aca9847f2 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Refreshing instance network info cache due to event network-changed-3d8642ff-7536-43c2-b539-addb31e07e9c. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:30:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-10b23cc7-cd0a-4cc9-a5bd-e7b1be943cd5 req-87215416-eaa4-47de-97c9-fd3aca9847f2 service nova] Acquiring lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:30:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-10b23cc7-cd0a-4cc9-a5bd-e7b1be943cd5 req-87215416-eaa4-47de-97c9-fd3aca9847f2 service nova] Acquired lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:30:38 user nova-compute[72447]: DEBUG nova.network.neutron [req-10b23cc7-cd0a-4cc9-a5bd-e7b1be943cd5 req-87215416-eaa4-47de-97c9-fd3aca9847f2 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Refreshing network info cache for port 3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG nova.objects.instance [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lazy-loading 'flavor' on Instance uuid d4bd5550-6cd3-4177-afbd-1e4981eeec99 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG nova.network.neutron [req-10b23cc7-cd0a-4cc9-a5bd-e7b1be943cd5 req-87215416-eaa4-47de-97c9-fd3aca9847f2 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Updated VIF entry in instance network info cache for port 3d8642ff-7536-43c2-b539-addb31e07e9c. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG nova.network.neutron [req-10b23cc7-cd0a-4cc9-a5bd-e7b1be943cd5 req-87215416-eaa4-47de-97c9-fd3aca9847f2 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Updating instance_info_cache with network_info: [{"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-10b23cc7-cd0a-4cc9-a5bd-e7b1be943cd5 req-87215416-eaa4-47de-97c9-fd3aca9847f2 service nova] Releasing lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:39 user nova-compute[72447]: INFO nova.compute.manager [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Attaching volume 5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 to /dev/vdb
Jul 31 12:30:39 user nova-compute[72447]: DEBUG os_brick.utils [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a723078-5396-4db6-ada3-a354fe098fe9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92d2aa6-b7c3-4fe6-8b73-35235ccb673c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b150cd-1561-4d45-8fa5-30e38a41c443]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[613175fb-4bd1-4e52-b006-30633f179c65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:30:39 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:30:39 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f53db1a-0502-4914-a6ad-9c2d9c86f829]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG os_brick.utils [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:30:39 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Updating existing volume attachment record: d34de3ad-5a14-4a95-9f42-7a6c55a04271 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:30:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:30:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NnBFXQJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:30:46 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:30:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:30:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:30:46 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:30:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:30:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:30:46 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:30:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1830c14c-0a49-43fa-bf7e-40d5eafba88e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:30:46 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce907b4-4b8a-46f6-a9b8-4e372881185b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3] added
Jul 31 12:30:47 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec0e789-8abc-483b-991b-8dfa7c6192c5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96d2ff1-1c91-43ea-a728-c1d0f0b8107a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NnBFXQJp {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NnBFXQJp" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[350cde9f-8d61-4823-9fce-4276077f5646]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NnBFXQJp'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ad1b9a-df2c-45bf-b1c2-ec6fde67464c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[69117d48-ad56-455f-a29b-0f5fc237bbd7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:30:47 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:30:47 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:30:47 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:30:47 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:30:47 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:30:47 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a8e4b6-8765-4c38-88eb-158d8ae3b9ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3, portal: 172.16.0.220,3260]
Jul 31 12:30:47 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3, portal: 172.16.0.220,3260] successful.
Jul 31 12:30:47 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb3fc81-04ce-46ff-9c39-bace68d2910f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[494efbf0-ae6d-4d07-9699-d003df6a76ce]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:30:47 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:30:47 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:30:47 user nova-compute[72447]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 (non-flash)
Jul 31 12:30:47 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:30:47 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:30:47 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:30:47 user nova-compute[72447]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 (non-flash)
Jul 31 12:30:47 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec36dfe-7623-4483-9764-05e0184a7b5d]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:30:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NnBFXQJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:30:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:30:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23034363363613936', 'path': '/dev/sde'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:30:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034363363613936', 'path': '/dev/sde'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:30:48 user nova-compute[72447]: DEBUG nova.objects.instance [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lazy-loading 'flavor' on Instance uuid d4bd5550-6cd3-4177-afbd-1e4981eeec99 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:30:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:30:48 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:30:48 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:30:48 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:30:48 user nova-compute[72447]:   <serial>5f5eed10-97a0-4f85-9055-63cb6d3a8ac3</serial>
Jul 31 12:30:48 user nova-compute[72447]: </disk>
Jul 31 12:30:48 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:30:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:30:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:30:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] No VIF found with MAC fa:16:3e:05:a4:49, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:30:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-af86f81a-990d-4cda-a78d-f08a339b14a4 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.481s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:50 user nova-compute[72447]: INFO nova.compute.manager [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Detaching volume 5f5eed10-97a0-4f85-9055-63cb6d3a8ac3
Jul 31 12:30:50 user nova-compute[72447]: INFO nova.virt.block_device [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Attempting to driver detach volume 5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 from mountpoint /dev/vdb
Jul 31 12:30:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Attempting to detach device vdb from instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:30:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:30:50 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:30:50 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:30:50 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:30:50 user nova-compute[72447]:   <serial>5f5eed10-97a0-4f85-9055-63cb6d3a8ac3</serial>
Jul 31 12:30:50 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:30:50 user nova-compute[72447]: </disk>
Jul 31 12:30:50 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:30:50 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Successfully detached device vdb from instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 from the persistent domain config.
Jul 31 12:30:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:30:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:30:50 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:30:50 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:30:50 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:30:50 user nova-compute[72447]:   <serial>5f5eed10-97a0-4f85-9055-63cb6d3a8ac3</serial>
Jul 31 12:30:50 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:30:50 user nova-compute[72447]: </disk>
Jul 31 12:30:50 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-b837c2ad-e895-4e88-9e2c-622f554e0d30 req-f8ca32a0-95eb-4c7f-8e9c-42f9f307d5c0 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-changed-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG nova.compute.manager [req-b837c2ad-e895-4e88-9e2c-622f554e0d30 req-f8ca32a0-95eb-4c7f-8e9c-42f9f307d5c0 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Refreshing instance network info cache due to event network-changed-23148cca-e577-4eaa-ab83-b87a4d7dd713. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b837c2ad-e895-4e88-9e2c-622f554e0d30 req-f8ca32a0-95eb-4c7f-8e9c-42f9f307d5c0 service nova] Acquiring lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b837c2ad-e895-4e88-9e2c-622f554e0d30 req-f8ca32a0-95eb-4c7f-8e9c-42f9f307d5c0 service nova] Acquired lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG nova.network.neutron [req-b837c2ad-e895-4e88-9e2c-622f554e0d30 req-f8ca32a0-95eb-4c7f-8e9c-42f9f307d5c0 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Refreshing network info cache for port 23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806651.1024299, d4bd5550-6cd3-4177-afbd-1e4981eeec99 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:30:51 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Successfully detached device vdb from instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 from the live domain config.
Jul 31 12:30:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NnBFXQJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:30:51 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6354b2b-a868-4861-ac90-1c7ae0ccb19f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c18e5cc-2d80-4b51-9866-0975a9d4f7e7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:30:51 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:30:51 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:30:51 user nova-compute[72447]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 (non-flash)
Jul 31 12:30:51 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:30:51 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:30:51 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:30:51 user nova-compute[72447]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 (non-flash)
Jul 31 12:30:51 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06682e5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3'): ({'sde'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Removing single pathed devices sde {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae65dc57-656d-4fbc-9cd6-75125d468712]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1cfcd6-388b-48be-b3c4-659e2dbf8c7e]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Flushing IO for device /dev/sde {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3633e813-5c8c-484d-adf7-601c3eafb819]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7a26b0-afb1-4811-820a-e0d653c54d1a]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e04628-0a18-4bba-aad1-f75e6337d7b6]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[773fded9-9af6-425b-8737-f68de6fdcb2c]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3, portal: 172.16.0.220,3260]
Jul 31 12:30:51 user nova-compute[72447]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3, portal: 172.16.0.220,3260] successful.
Jul 31 12:30:51 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5eed10-97a0-4f85-9055-63cb6d3a8ac3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[72501aa2-c8fd-402a-b436-70e3afab5746]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] <== disconnect_volume: return (311ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:30:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:30:52 user nova-compute[72447]: DEBUG nova.objects.instance [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lazy-loading 'flavor' on Instance uuid d4bd5550-6cd3-4177-afbd-1e4981eeec99 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:30:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-11dc236b-3ec0-45f5-9bfe-d66fb9bd23ae tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.735s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:52 user nova-compute[72447]: DEBUG nova.network.neutron [req-b837c2ad-e895-4e88-9e2c-622f554e0d30 req-f8ca32a0-95eb-4c7f-8e9c-42f9f307d5c0 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updated VIF entry in instance network info cache for port 23148cca-e577-4eaa-ab83-b87a4d7dd713. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:30:52 user nova-compute[72447]: DEBUG nova.network.neutron [req-b837c2ad-e895-4e88-9e2c-622f554e0d30 req-f8ca32a0-95eb-4c7f-8e9c-42f9f307d5c0 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updating instance_info_cache with network_info: [{"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:30:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b837c2ad-e895-4e88-9e2c-622f554e0d30 req-f8ca32a0-95eb-4c7f-8e9c-42f9f307d5c0 service nova] Releasing lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:30:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:30:57 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG nova.objects.instance [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:30:58 user nova-compute[72447]: INFO nova.compute.manager [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Attaching volume 9bb2e350-4c8b-4d57-9ca5-592d94123795 to /dev/vdb
Jul 31 12:30:58 user nova-compute[72447]: DEBUG os_brick.utils [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5287470-f260-48f8-8fb4-3dd4a88c2bf3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2950e5f2-f5b8-4f54-9851-59fbc5a1e9bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d83b4c-8228-4980-b6ae-8f9ba8d7e169]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a556063-5ad0-4514-ab89-dd2b7ec7f43a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:30:58 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:30:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0635cc43-b6c8-4699-9dc7-bbdf0539b58e]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG os_brick.utils [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:30:58 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updating existing volume attachment record: 1255194e-1a2a-4fd3-bea7-ad7df752cf77 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:30:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:02 user nova-compute[72447]: DEBUG nova.compute.manager [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:31:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:02 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:31:02 user nova-compute[72447]: INFO nova.compute.claims [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Claim successful on node user
Jul 31 12:31:03 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG nova.network.neutron [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:31:03 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:31:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:31:03 user nova-compute[72447]: INFO nova.compute.manager [None req-ee7bee01-6bd5-4d9e-b67e-3fa4bb4b9dbc tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Unrescuing
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7bee01-6bd5-4d9e-b67e-3fa4bb4b9dbc tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "refresh_cache-6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7bee01-6bd5-4d9e-b67e-3fa4bb4b9dbc tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquired lock "refresh_cache-6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ee7bee01-6bd5-4d9e-b67e-3fa4bb4b9dbc tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:31:03 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Creating image(s)
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "/opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "/opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "/opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG nova.policy [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9517e4295d8c4e22a09e193f9687811c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46c90a8c1f42aeb9e63db6aa240ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk 1073741824" returned: 0 in 0.053s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ee7bee01-6bd5-4d9e-b67e-3fa4bb4b9dbc tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Updating instance_info_cache with network_info: [{"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ee7bee01-6bd5-4d9e-b67e-3fa4bb4b9dbc tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Releasing lock "refresh_cache-6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.objects.instance [None req-ee7bee01-6bd5-4d9e-b67e-3fa4bb4b9dbc tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'flavor' on Instance uuid 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.150s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Cannot resize image /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.objects.instance [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lazy-loading 'migration_context' on Instance uuid 8213834b-8f6f-45eb-a1b7-8ad0561ce275 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Ensure instance console log exists: /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-316c921c-0f2f-4264-9786-1621b2739a6b req-2d7ffa0f-780a-4efc-bbb0-786bd38b94e2 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-unplugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-316c921c-0f2f-4264-9786-1621b2739a6b req-2d7ffa0f-780a-4efc-bbb0-786bd38b94e2 service nova] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-316c921c-0f2f-4264-9786-1621b2739a6b req-2d7ffa0f-780a-4efc-bbb0-786bd38b94e2 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-316c921c-0f2f-4264-9786-1621b2739a6b req-2d7ffa0f-780a-4efc-bbb0-786bd38b94e2 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-316c921c-0f2f-4264-9786-1621b2739a6b req-2d7ffa0f-780a-4efc-bbb0-786bd38b94e2 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] No waiting events found dispatching network-vif-unplugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:04 user nova-compute[72447]: WARNING nova.compute.manager [req-316c921c-0f2f-4264-9786-1621b2739a6b req-2d7ffa0f-780a-4efc-bbb0-786bd38b94e2 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received unexpected event network-vif-unplugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updating instance_info_cache with network_info: [{"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-51310b38-96e0-4d44-ab1e-8d2cc039617e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:04 user nova-compute[72447]: DEBUG nova.network.neutron [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Successfully created port: 77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:31:04 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Instance destroyed successfully.
Jul 31 12:31:05 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:31:05 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:31:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Successfully updated port: 77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:31:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "refresh_cache-8213834b-8f6f-45eb-a1b7-8ad0561ce275" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:31:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquired lock "refresh_cache-8213834b-8f6f-45eb-a1b7-8ad0561ce275" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:31:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:31:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-d92fe268-cfeb-4eba-9bc6-9370d4ea0573 req-e5e7de6f-03b1-4744-85ec-04f37165e1d4 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Received event network-changed-77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-d92fe268-cfeb-4eba-9bc6-9370d4ea0573 req-e5e7de6f-03b1-4744-85ec-04f37165e1d4 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Refreshing instance network info cache due to event network-changed-77c8b570-0995-4ad9-b741-5d4a8bdb8920. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:31:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d92fe268-cfeb-4eba-9bc6-9370d4ea0573 req-e5e7de6f-03b1-4744-85ec-04f37165e1d4 service nova] Acquiring lock "refresh_cache-8213834b-8f6f-45eb-a1b7-8ad0561ce275" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:31:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Updating instance_info_cache with network_info: [{"id": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "address": "fa:16:3e:63:eb:94", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c8b570-09", "ovs_interfaceid": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Releasing lock "refresh_cache-8213834b-8f6f-45eb-a1b7-8ad0561ce275" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.compute.manager [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Instance network_info: |[{"id": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "address": "fa:16:3e:63:eb:94", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c8b570-09", "ovs_interfaceid": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d92fe268-cfeb-4eba-9bc6-9370d4ea0573 req-e5e7de6f-03b1-4744-85ec-04f37165e1d4 service nova] Acquired lock "refresh_cache-8213834b-8f6f-45eb-a1b7-8ad0561ce275" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-d92fe268-cfeb-4eba-9bc6-9370d4ea0573 req-e5e7de6f-03b1-4744-85ec-04f37165e1d4 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Refreshing network info cache for port 77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Start _get_guest_xml network_info=[{"id": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "address": "fa:16:3e:63:eb:94", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c8b570-09", "ovs_interfaceid": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:31:06 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:31:06 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1145354721',display_name='tempest-VolumesSnapshotTestJSON-instance-1145354721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1145354721',id=41,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTVxYXvV38GMK176OYxKqxYxP7nqKJsXoWc0YsXOq8g4GJdUMhNs0KnpreSpAV333n/0w5vyLzUvRAXWYsV7/ys4ZtBsr0bqUPmlYzctdVZ11GOddlJDQ0FMjjDOkg1Ig==',key_name='tempest-keypair-2121850395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c46c90a8c1f42aeb9e63db6aa240ab5',ramdisk_id='',reservation_id='r-5klmjgxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1298774726',owner_user_name='tempest-VolumesSnapshotTestJSON-1298774726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9517e4295d8c4e22a09e193f9687811c',uuid=8213834b-8f6f-45eb-a1b7-8ad0561ce275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "address": "fa:16:3e:63:eb:94", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c8b570-09", "ovs_interfaceid": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Converting VIF {"id": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "address": "fa:16:3e:63:eb:94", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c8b570-09", "ovs_interfaceid": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:eb:94,bridge_name='br-int',has_traffic_filtering=True,id=77c8b570-0995-4ad9-b741-5d4a8bdb8920,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c8b570-09') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.objects.instance [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lazy-loading 'pci_devices' on Instance uuid 8213834b-8f6f-45eb-a1b7-8ad0561ce275 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:31:06 user nova-compute[72447]:   <uuid>8213834b-8f6f-45eb-a1b7-8ad0561ce275</uuid>
Jul 31 12:31:06 user nova-compute[72447]:   <name>instance-00000029</name>
Jul 31 12:31:06 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:31:06 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:31:06 user nova-compute[72447]:   <metadata>
Jul 31 12:31:06 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:31:06 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:31:06 user nova-compute[72447]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1145354721</nova:name>
Jul 31 12:31:06 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:31:06</nova:creationTime>
Jul 31 12:31:06 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:31:06 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:31:06 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:31:06 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:31:06 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:31:06 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:31:06 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:31:06 user nova-compute[72447]:       <nova:owner>
Jul 31 12:31:06 user nova-compute[72447]:         <nova:user uuid="9517e4295d8c4e22a09e193f9687811c">tempest-VolumesSnapshotTestJSON-1298774726-project-member</nova:user>
Jul 31 12:31:06 user nova-compute[72447]:         <nova:project uuid="4c46c90a8c1f42aeb9e63db6aa240ab5">tempest-VolumesSnapshotTestJSON-1298774726</nova:project>
Jul 31 12:31:06 user nova-compute[72447]:       </nova:owner>
Jul 31 12:31:06 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:31:06 user nova-compute[72447]:       <nova:ports>
Jul 31 12:31:06 user nova-compute[72447]:         <nova:port uuid="77c8b570-0995-4ad9-b741-5d4a8bdb8920">
Jul 31 12:31:06 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 12:31:06 user nova-compute[72447]:         </nova:port>
Jul 31 12:31:06 user nova-compute[72447]:       </nova:ports>
Jul 31 12:31:06 user nova-compute[72447]:     </nova:instance>
Jul 31 12:31:06 user nova-compute[72447]:   </metadata>
Jul 31 12:31:06 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:31:06 user nova-compute[72447]:     <system>
Jul 31 12:31:06 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:31:06 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:31:06 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:31:06 user nova-compute[72447]:       <entry name="serial">8213834b-8f6f-45eb-a1b7-8ad0561ce275</entry>
Jul 31 12:31:06 user nova-compute[72447]:       <entry name="uuid">8213834b-8f6f-45eb-a1b7-8ad0561ce275</entry>
Jul 31 12:31:06 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:31:06 user nova-compute[72447]:     </system>
Jul 31 12:31:06 user nova-compute[72447]:   </sysinfo>
Jul 31 12:31:06 user nova-compute[72447]:   <os>
Jul 31 12:31:06 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:31:06 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:31:06 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:31:06 user nova-compute[72447]:   </os>
Jul 31 12:31:06 user nova-compute[72447]:   <features>
Jul 31 12:31:06 user nova-compute[72447]:     <acpi/>
Jul 31 12:31:06 user nova-compute[72447]:     <apic/>
Jul 31 12:31:06 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:31:06 user nova-compute[72447]:   </features>
Jul 31 12:31:06 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:31:06 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:31:06 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:31:06 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:31:06 user nova-compute[72447]:   </clock>
Jul 31 12:31:06 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:31:06 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:31:06 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:31:06 user nova-compute[72447]:   </cpu>
Jul 31 12:31:06 user nova-compute[72447]:   <devices>
Jul 31 12:31:06 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:31:06 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:31:06 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk"/>
Jul 31 12:31:06 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:31:06 user nova-compute[72447]:     </disk>
Jul 31 12:31:06 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:31:06 user nova-compute[72447]:       <mac address="fa:16:3e:63:eb:94"/>
Jul 31 12:31:06 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:31:06 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:31:06 user nova-compute[72447]:       <target dev="tap77c8b570-09"/>
Jul 31 12:31:06 user nova-compute[72447]:     </interface>
Jul 31 12:31:06 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:31:06 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/console.log" append="off"/>
Jul 31 12:31:06 user nova-compute[72447]:     </serial>
Jul 31 12:31:06 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:31:06 user nova-compute[72447]:     <video>
Jul 31 12:31:06 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:31:06 user nova-compute[72447]:     </video>
Jul 31 12:31:06 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:31:06 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:31:06 user nova-compute[72447]:     </rng>
Jul 31 12:31:06 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:31:06 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:31:06 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:31:06 user nova-compute[72447]:     </memballoon>
Jul 31 12:31:06 user nova-compute[72447]:   </devices>
Jul 31 12:31:06 user nova-compute[72447]: </domain>
Jul 31 12:31:06 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1145354721',display_name='tempest-VolumesSnapshotTestJSON-instance-1145354721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1145354721',id=41,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTVxYXvV38GMK176OYxKqxYxP7nqKJsXoWc0YsXOq8g4GJdUMhNs0KnpreSpAV333n/0w5vyLzUvRAXWYsV7/ys4ZtBsr0bqUPmlYzctdVZ11GOddlJDQ0FMjjDOkg1Ig==',key_name='tempest-keypair-2121850395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c46c90a8c1f42aeb9e63db6aa240ab5',ramdisk_id='',reservation_id='r-5klmjgxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1298774726',owner_user_name='tempest-VolumesSnapshotTestJSON-1298774726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9517e4295d8c4e22a09e193f9687811c',uuid=8213834b-8f6f-45eb-a1b7-8ad0561ce275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "address": "fa:16:3e:63:eb:94", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c8b570-09", "ovs_interfaceid": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Converting VIF {"id": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "address": "fa:16:3e:63:eb:94", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c8b570-09", "ovs_interfaceid": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:eb:94,bridge_name='br-int',has_traffic_filtering=True,id=77c8b570-0995-4ad9-b741-5d4a8bdb8920,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c8b570-09') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_vif [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:eb:94,bridge_name='br-int',has_traffic_filtering=True,id=77c8b570-0995-4ad9-b741-5d4a8bdb8920,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c8b570-09') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77c8b570-09, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77c8b570-09, col_values=(('external_ids', {'iface-id': '77c8b570-0995-4ad9-b741-5d4a8bdb8920', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:eb:94', 'vm-uuid': '8213834b-8f6f-45eb-a1b7-8ad0561ce275'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:06 user nova-compute[72447]: INFO os_vif [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:eb:94,bridge_name='br-int',has_traffic_filtering=True,id=77c8b570-0995-4ad9-b741-5d4a8bdb8920,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c8b570-09')
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] No VIF found with MAC fa:16:3e:63:eb:94, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-99c3a906-b631-4450-8534-2e68a123c82f req-e816c396-0f00-41fb-904a-f9a06b7f5fa4 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-99c3a906-b631-4450-8534-2e68a123c82f req-e816c396-0f00-41fb-904a-f9a06b7f5fa4 service nova] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-99c3a906-b631-4450-8534-2e68a123c82f req-e816c396-0f00-41fb-904a-f9a06b7f5fa4 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-99c3a906-b631-4450-8534-2e68a123c82f req-e816c396-0f00-41fb-904a-f9a06b7f5fa4 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-99c3a906-b631-4450-8534-2e68a123c82f req-e816c396-0f00-41fb-904a-f9a06b7f5fa4 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] No waiting events found dispatching network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:06 user nova-compute[72447]: WARNING nova.compute.manager [req-99c3a906-b631-4450-8534-2e68a123c82f req-e816c396-0f00-41fb-904a-f9a06b7f5fa4 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received unexpected event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-99c3a906-b631-4450-8534-2e68a123c82f req-e816c396-0f00-41fb-904a-f9a06b7f5fa4 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-99c3a906-b631-4450-8534-2e68a123c82f req-e816c396-0f00-41fb-904a-f9a06b7f5fa4 service nova] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-99c3a906-b631-4450-8534-2e68a123c82f req-e816c396-0f00-41fb-904a-f9a06b7f5fa4 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-99c3a906-b631-4450-8534-2e68a123c82f req-e816c396-0f00-41fb-904a-f9a06b7f5fa4 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-99c3a906-b631-4450-8534-2e68a123c82f req-e816c396-0f00-41fb-904a-f9a06b7f5fa4 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] No waiting events found dispatching network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:06 user nova-compute[72447]: WARNING nova.compute.manager [req-99c3a906-b631-4450-8534-2e68a123c82f req-e816c396-0f00-41fb-904a-f9a06b7f5fa4 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received unexpected event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKlaHuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:31:06 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:31:06 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:31:06 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e67f86f-3b19-4be6-9cf4-6198eb9eb595]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:31:06 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-d92fe268-cfeb-4eba-9bc6-9370d4ea0573 req-e5e7de6f-03b1-4744-85ec-04f37165e1d4 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Updated VIF entry in instance network info cache for port 77c8b570-0995-4ad9-b741-5d4a8bdb8920. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-d92fe268-cfeb-4eba-9bc6-9370d4ea0573 req-e5e7de6f-03b1-4744-85ec-04f37165e1d4 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Updating instance_info_cache with network_info: [{"id": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "address": "fa:16:3e:63:eb:94", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c8b570-09", "ovs_interfaceid": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e535e8ec-8fcd-4ff8-8af8-2ff34541f159]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795] added
Jul 31 12:31:06 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d92fe268-cfeb-4eba-9bc6-9370d4ea0573 req-e5e7de6f-03b1-4744-85ec-04f37165e1d4 service nova] Releasing lock "refresh_cache-8213834b-8f6f-45eb-a1b7-8ad0561ce275" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8104356-7f4c-4ca1-8df6-ae194879d428]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59f0d90-df1a-4f17-9db8-35774b40267a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrKlaHuD {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrKlaHuD" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc47081f-8fc6-4c71-9cac-82e14dc10379]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vrKlaHuD'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde9a942-5a85-4a11-a25a-45e3bb817ab2]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[643ee5de-16af-4eb5-b771-b81ad74f5867]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:31:06 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:31:06 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:31:06 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:31:06 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:31:06 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:31:06 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3899ba-58d6-46ec-8e46-2e46f350630e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260]
Jul 31 12:31:06 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260] successful.
Jul 31 12:31:06 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc51dab-86a5-4304-9ad4-85fbb9a2913a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:31:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33bfdbe-5b7b-436e-b3e8-0adbd334e48f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:31:07 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:31:07 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:31:07 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:31:07 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:31:07 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:31:07 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:31:07 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:31:07 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c61d2d-ca19-4680-84f9-35cd6d03b203]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKlaHuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:31:07 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23734666230356635', 'path': '/dev/sde'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734666230356635', 'path': '/dev/sde'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG nova.objects.instance [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:31:08 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:31:08 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:31:08 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:31:08 user nova-compute[72447]:   <serial>9bb2e350-4c8b-4d57-9ca5-592d94123795</serial>
Jul 31 12:31:08 user nova-compute[72447]: </disk>
Jul 31 12:31:08 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-f016659c-addb-4f99-9a57-6da935c6441c req-4729c48d-0f1e-4937-a75e-69de72f009ce service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Received event network-vif-plugged-77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f016659c-addb-4f99-9a57-6da935c6441c req-4729c48d-0f1e-4937-a75e-69de72f009ce service nova] Acquiring lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f016659c-addb-4f99-9a57-6da935c6441c req-4729c48d-0f1e-4937-a75e-69de72f009ce service nova] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f016659c-addb-4f99-9a57-6da935c6441c req-4729c48d-0f1e-4937-a75e-69de72f009ce service nova] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-f016659c-addb-4f99-9a57-6da935c6441c req-4729c48d-0f1e-4937-a75e-69de72f009ce service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] No waiting events found dispatching network-vif-plugged-77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:08 user nova-compute[72447]: WARNING nova.compute.manager [req-f016659c-addb-4f99-9a57-6da935c6441c req-4729c48d-0f1e-4937-a75e-69de72f009ce service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Received unexpected event network-vif-plugged-77c8b570-0995-4ad9-b741-5d4a8bdb8920 for instance with vm_state building and task_state spawning.
Jul 31 12:31:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-536d0b46-4c62-40db-80ba-0ab336214663 req-10cf9b02-96be-412c-a284-c8776c3afffc service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-536d0b46-4c62-40db-80ba-0ab336214663 req-10cf9b02-96be-412c-a284-c8776c3afffc service nova] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-536d0b46-4c62-40db-80ba-0ab336214663 req-10cf9b02-96be-412c-a284-c8776c3afffc service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-536d0b46-4c62-40db-80ba-0ab336214663 req-10cf9b02-96be-412c-a284-c8776c3afffc service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG nova.compute.manager [req-536d0b46-4c62-40db-80ba-0ab336214663 req-10cf9b02-96be-412c-a284-c8776c3afffc service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] No waiting events found dispatching network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:08 user nova-compute[72447]: WARNING nova.compute.manager [req-536d0b46-4c62-40db-80ba-0ab336214663 req-10cf9b02-96be-412c-a284-c8776c3afffc service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received unexpected event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 for instance with vm_state rescued and task_state unrescuing.
Jul 31 12:31:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No VIF found with MAC fa:16:3e:0c:31:61, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-90434d50-d3c9-4edf-9f87-9bcc8b2fb9b6 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.307s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d63c38df-1718-4cad-812a-33d7ca47fe6f tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d63c38df-1718-4cad-812a-33d7ca47fe6f tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d63c38df-1718-4cad-812a-33d7ca47fe6f tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d63c38df-1718-4cad-812a-33d7ca47fe6f tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72447) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG nova.objects.instance [None req-d63c38df-1718-4cad-812a-33d7ca47fe6f tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Removed pending event for 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 due to event {{(pid=72447) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806669.880694, 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:31:09 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] VM Resumed (Lifecycle Event)
Jul 31 12:31:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ee7bee01-6bd5-4d9e-b67e-3fa4bb4b9dbc tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:31:10 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 12:31:10 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806669.8815424, 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:31:10 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] VM Started (Lifecycle Event)
Jul 31 12:31:10 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:10 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance destroyed successfully.
Jul 31 12:31:10 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d63c38df-1718-4cad-812a-33d7ca47fe6f tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d63c38df-1718-4cad-812a-33d7ca47fe6f tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.236s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:10 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Received event network-vif-plugged-77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] Acquiring lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] No waiting events found dispatching network-vif-plugged-77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:11 user nova-compute[72447]: WARNING nova.compute.manager [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Received unexpected event network-vif-plugged-77c8b570-0995-4ad9-b741-5d4a8bdb8920 for instance with vm_state building and task_state spawning.
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-unplugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] No waiting events found dispatching network-vif-unplugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:11 user nova-compute[72447]: WARNING nova.compute.manager [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received unexpected event network-vif-unplugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 for instance with vm_state stopped and task_state None.
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] No waiting events found dispatching network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:11 user nova-compute[72447]: WARNING nova.compute.manager [req-20ff8374-24f3-4037-b92c-da7d533a32ba req-4fc69540-2006-4af3-9e07-20a06df905c3 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received unexpected event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 for instance with vm_state stopped and task_state None.
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806671.1485834, 8213834b-8f6f-45eb-a1b7-8ad0561ce275 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:31:11 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] VM Resumed (Lifecycle Event)
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:31:11 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Instance spawned successfully.
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:11 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806671.1560326, 8213834b-8f6f-45eb-a1b7-8ad0561ce275 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:31:11 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] VM Started (Lifecycle Event)
Jul 31 12:31:11 user nova-compute[72447]: INFO nova.compute.manager [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Took 7.72 seconds to spawn the instance on the hypervisor.
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:31:11 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:11 user nova-compute[72447]: INFO nova.compute.manager [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Took 8.97 seconds to build instance.
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-34caa9bf-21a6-4546-a4d4-3b1aae90067f tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.110s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:31:12 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:31:12 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7690MB free_disk=24.955490112304688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance f3f1534b-16c0-4dee-b78c-d53713113a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 2a481721-232b-4a4d-83ad-cfbac144bb5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 48e13eb4-f1e9-415d-8167-1ab683d1680e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 8213834b-8f6f-45eb-a1b7-8ad0561ce275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:31:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:31:13 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:31:13 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:31:13 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:31:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:31:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:31:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:25 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806670.7357776, 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:31:25 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] VM Stopped (Lifecycle Event)
Jul 31 12:31:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-32ed0218-72c8-409a-81fd-d6fa2055f0d9 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-32ed0218-72c8-409a-81fd-d6fa2055f0d9 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:31:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:31:27 user nova-compute[72447]: INFO nova.compute.claims [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Claim successful on node user
Jul 31 12:31:27 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG nova.network.neutron [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:31:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:31:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG nova.policy [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96e413ee6ade47fda14082abe8592c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b255b73bddd844339eb858285c00db00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:31:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Creating image(s)
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "/opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "/opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "/opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:27 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk 1073741824" returned: 0 in 0.054s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Cannot resize image /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG nova.objects.instance [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'migration_context' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG nova.network.neutron [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Successfully created port: a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Ensure instance console log exists: /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.network.neutron [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Successfully updated port: a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "refresh_cache-6707cbc8-a675-4248-b324-40630ebff478" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquired lock "refresh_cache-6707cbc8-a675-4248-b324-40630ebff478" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.network.neutron [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.network.neutron [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-cbd4d080-6450-4480-971a-e168d4ea047c req-7f4cb477-2994-4d44-b804-ea33848d7a4f service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Received event network-changed-a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-cbd4d080-6450-4480-971a-e168d4ea047c req-7f4cb477-2994-4d44-b804-ea33848d7a4f service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Refreshing instance network info cache due to event network-changed-a880d610-9f14-4c6b-9326-35e1acfadce9. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cbd4d080-6450-4480-971a-e168d4ea047c req-7f4cb477-2994-4d44-b804-ea33848d7a4f service nova] Acquiring lock "refresh_cache-6707cbc8-a675-4248-b324-40630ebff478" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.network.neutron [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Updating instance_info_cache with network_info: [{"id": "a880d610-9f14-4c6b-9326-35e1acfadce9", "address": "fa:16:3e:cb:dd:96", "network": {"id": "7a6b5ac7-4005-4a8b-9e99-f243de007ed1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1888569421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b255b73bddd844339eb858285c00db00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa880d610-9f", "ovs_interfaceid": "a880d610-9f14-4c6b-9326-35e1acfadce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Releasing lock "refresh_cache-6707cbc8-a675-4248-b324-40630ebff478" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Instance network_info: |[{"id": "a880d610-9f14-4c6b-9326-35e1acfadce9", "address": "fa:16:3e:cb:dd:96", "network": {"id": "7a6b5ac7-4005-4a8b-9e99-f243de007ed1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1888569421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b255b73bddd844339eb858285c00db00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa880d610-9f", "ovs_interfaceid": "a880d610-9f14-4c6b-9326-35e1acfadce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cbd4d080-6450-4480-971a-e168d4ea047c req-7f4cb477-2994-4d44-b804-ea33848d7a4f service nova] Acquired lock "refresh_cache-6707cbc8-a675-4248-b324-40630ebff478" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.network.neutron [req-cbd4d080-6450-4480-971a-e168d4ea047c req-7f4cb477-2994-4d44-b804-ea33848d7a4f service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Refreshing network info cache for port a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Start _get_guest_xml network_info=[{"id": "a880d610-9f14-4c6b-9326-35e1acfadce9", "address": "fa:16:3e:cb:dd:96", "network": {"id": "7a6b5ac7-4005-4a8b-9e99-f243de007ed1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1888569421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b255b73bddd844339eb858285c00db00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa880d610-9f", "ovs_interfaceid": "a880d610-9f14-4c6b-9326-35e1acfadce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:31:29 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:31:29 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2070769532',display_name='tempest-SnapshotDataIntegrityTests-server-2070769532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2070769532',id=42,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINkbrkfJpKZmjBN9r7SLximw1BfoVx3NWjHFn4ZiQwKeftdltQse3DNF+Y8RlYrdgiDTQ6n+fIuW5wbU56Xh64d4x9KlDkb8VqcfweZZjJ1YhZZOrsOQjLCrbJS6DE2Jw==',key_name='tempest-keypair-509508350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b255b73bddd844339eb858285c00db00',ramdisk_id='',reservation_id='r-199on6c8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-582576876',owner_user_name='tempest-SnapshotDataIntegrityTests-582576876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96e413ee6ade47fda14082abe8592c55',uuid=6707cbc8-a675-4248-b324-40630ebff478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a880d610-9f14-4c6b-9326-35e1acfadce9", "address": "fa:16:3e:cb:dd:96", "network": {"id": "7a6b5ac7-4005-4a8b-9e99-f243de007ed1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1888569421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b255b73bddd844339eb858285c00db00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa880d610-9f", "ovs_interfaceid": "a880d610-9f14-4c6b-9326-35e1acfadce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Converting VIF {"id": "a880d610-9f14-4c6b-9326-35e1acfadce9", "address": "fa:16:3e:cb:dd:96", "network": {"id": "7a6b5ac7-4005-4a8b-9e99-f243de007ed1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1888569421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b255b73bddd844339eb858285c00db00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa880d610-9f", "ovs_interfaceid": "a880d610-9f14-4c6b-9326-35e1acfadce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:dd:96,bridge_name='br-int',has_traffic_filtering=True,id=a880d610-9f14-4c6b-9326-35e1acfadce9,network=Network(7a6b5ac7-4005-4a8b-9e99-f243de007ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa880d610-9f') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.objects.instance [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'pci_devices' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:31:29 user nova-compute[72447]:   <uuid>6707cbc8-a675-4248-b324-40630ebff478</uuid>
Jul 31 12:31:29 user nova-compute[72447]:   <name>instance-0000002a</name>
Jul 31 12:31:29 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:31:29 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:31:29 user nova-compute[72447]:   <metadata>
Jul 31 12:31:29 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:31:29 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:31:29 user nova-compute[72447]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2070769532</nova:name>
Jul 31 12:31:29 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:31:29</nova:creationTime>
Jul 31 12:31:29 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:31:29 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:31:29 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:31:29 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:31:29 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:31:29 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:31:29 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:31:29 user nova-compute[72447]:       <nova:owner>
Jul 31 12:31:29 user nova-compute[72447]:         <nova:user uuid="96e413ee6ade47fda14082abe8592c55">tempest-SnapshotDataIntegrityTests-582576876-project-member</nova:user>
Jul 31 12:31:29 user nova-compute[72447]:         <nova:project uuid="b255b73bddd844339eb858285c00db00">tempest-SnapshotDataIntegrityTests-582576876</nova:project>
Jul 31 12:31:29 user nova-compute[72447]:       </nova:owner>
Jul 31 12:31:29 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:31:29 user nova-compute[72447]:       <nova:ports>
Jul 31 12:31:29 user nova-compute[72447]:         <nova:port uuid="a880d610-9f14-4c6b-9326-35e1acfadce9">
Jul 31 12:31:29 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 12:31:29 user nova-compute[72447]:         </nova:port>
Jul 31 12:31:29 user nova-compute[72447]:       </nova:ports>
Jul 31 12:31:29 user nova-compute[72447]:     </nova:instance>
Jul 31 12:31:29 user nova-compute[72447]:   </metadata>
Jul 31 12:31:29 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:31:29 user nova-compute[72447]:     <system>
Jul 31 12:31:29 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:31:29 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:31:29 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:31:29 user nova-compute[72447]:       <entry name="serial">6707cbc8-a675-4248-b324-40630ebff478</entry>
Jul 31 12:31:29 user nova-compute[72447]:       <entry name="uuid">6707cbc8-a675-4248-b324-40630ebff478</entry>
Jul 31 12:31:29 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:31:29 user nova-compute[72447]:     </system>
Jul 31 12:31:29 user nova-compute[72447]:   </sysinfo>
Jul 31 12:31:29 user nova-compute[72447]:   <os>
Jul 31 12:31:29 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:31:29 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:31:29 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:31:29 user nova-compute[72447]:   </os>
Jul 31 12:31:29 user nova-compute[72447]:   <features>
Jul 31 12:31:29 user nova-compute[72447]:     <acpi/>
Jul 31 12:31:29 user nova-compute[72447]:     <apic/>
Jul 31 12:31:29 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:31:29 user nova-compute[72447]:   </features>
Jul 31 12:31:29 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:31:29 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:31:29 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:31:29 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:31:29 user nova-compute[72447]:   </clock>
Jul 31 12:31:29 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:31:29 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:31:29 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:31:29 user nova-compute[72447]:   </cpu>
Jul 31 12:31:29 user nova-compute[72447]:   <devices>
Jul 31 12:31:29 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:31:29 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:31:29 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk"/>
Jul 31 12:31:29 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:31:29 user nova-compute[72447]:     </disk>
Jul 31 12:31:29 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:31:29 user nova-compute[72447]:       <mac address="fa:16:3e:cb:dd:96"/>
Jul 31 12:31:29 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:31:29 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:31:29 user nova-compute[72447]:       <target dev="tapa880d610-9f"/>
Jul 31 12:31:29 user nova-compute[72447]:     </interface>
Jul 31 12:31:29 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:31:29 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/console.log" append="off"/>
Jul 31 12:31:29 user nova-compute[72447]:     </serial>
Jul 31 12:31:29 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:31:29 user nova-compute[72447]:     <video>
Jul 31 12:31:29 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:31:29 user nova-compute[72447]:     </video>
Jul 31 12:31:29 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:31:29 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:31:29 user nova-compute[72447]:     </rng>
Jul 31 12:31:29 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:31:29 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:31:29 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:31:29 user nova-compute[72447]:     </memballoon>
Jul 31 12:31:29 user nova-compute[72447]:   </devices>
Jul 31 12:31:29 user nova-compute[72447]: </domain>
Jul 31 12:31:29 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2070769532',display_name='tempest-SnapshotDataIntegrityTests-server-2070769532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2070769532',id=42,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINkbrkfJpKZmjBN9r7SLximw1BfoVx3NWjHFn4ZiQwKeftdltQse3DNF+Y8RlYrdgiDTQ6n+fIuW5wbU56Xh64d4x9KlDkb8VqcfweZZjJ1YhZZOrsOQjLCrbJS6DE2Jw==',key_name='tempest-keypair-509508350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b255b73bddd844339eb858285c00db00',ramdisk_id='',reservation_id='r-199on6c8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-582576876',owner_user_name='tempest-SnapshotDataIntegrityTests-582576876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96e413ee6ade47fda14082abe8592c55',uuid=6707cbc8-a675-4248-b324-40630ebff478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a880d610-9f14-4c6b-9326-35e1acfadce9", "address": "fa:16:3e:cb:dd:96", "network": {"id": "7a6b5ac7-4005-4a8b-9e99-f243de007ed1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1888569421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b255b73bddd844339eb858285c00db00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa880d610-9f", "ovs_interfaceid": "a880d610-9f14-4c6b-9326-35e1acfadce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Converting VIF {"id": "a880d610-9f14-4c6b-9326-35e1acfadce9", "address": "fa:16:3e:cb:dd:96", "network": {"id": "7a6b5ac7-4005-4a8b-9e99-f243de007ed1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1888569421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b255b73bddd844339eb858285c00db00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa880d610-9f", "ovs_interfaceid": "a880d610-9f14-4c6b-9326-35e1acfadce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:dd:96,bridge_name='br-int',has_traffic_filtering=True,id=a880d610-9f14-4c6b-9326-35e1acfadce9,network=Network(7a6b5ac7-4005-4a8b-9e99-f243de007ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa880d610-9f') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG os_vif [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:dd:96,bridge_name='br-int',has_traffic_filtering=True,id=a880d610-9f14-4c6b-9326-35e1acfadce9,network=Network(7a6b5ac7-4005-4a8b-9e99-f243de007ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa880d610-9f') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa880d610-9f, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa880d610-9f, col_values=(('external_ids', {'iface-id': 'a880d610-9f14-4c6b-9326-35e1acfadce9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:dd:96', 'vm-uuid': '6707cbc8-a675-4248-b324-40630ebff478'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:29 user nova-compute[72447]: INFO os_vif [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:dd:96,bridge_name='br-int',has_traffic_filtering=True,id=a880d610-9f14-4c6b-9326-35e1acfadce9,network=Network(7a6b5ac7-4005-4a8b-9e99-f243de007ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa880d610-9f')
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:31:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No VIF found with MAC fa:16:3e:cb:dd:96, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:31:30 user nova-compute[72447]: DEBUG nova.network.neutron [req-cbd4d080-6450-4480-971a-e168d4ea047c req-7f4cb477-2994-4d44-b804-ea33848d7a4f service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Updated VIF entry in instance network info cache for port a880d610-9f14-4c6b-9326-35e1acfadce9. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:31:30 user nova-compute[72447]: DEBUG nova.network.neutron [req-cbd4d080-6450-4480-971a-e168d4ea047c req-7f4cb477-2994-4d44-b804-ea33848d7a4f service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Updating instance_info_cache with network_info: [{"id": "a880d610-9f14-4c6b-9326-35e1acfadce9", "address": "fa:16:3e:cb:dd:96", "network": {"id": "7a6b5ac7-4005-4a8b-9e99-f243de007ed1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1888569421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b255b73bddd844339eb858285c00db00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa880d610-9f", "ovs_interfaceid": "a880d610-9f14-4c6b-9326-35e1acfadce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:31:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cbd4d080-6450-4480-971a-e168d4ea047c req-7f4cb477-2994-4d44-b804-ea33848d7a4f service nova] Releasing lock "refresh_cache-6707cbc8-a675-4248-b324-40630ebff478" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:31:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:31 user nova-compute[72447]: INFO nova.compute.manager [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Terminating instance
Jul 31 12:31:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-2809b8da-a810-45a2-85c0-1de08d661a13 req-13725f14-f0b6-466b-8217-dcb792a866d2 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Received event network-vif-plugged-a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2809b8da-a810-45a2-85c0-1de08d661a13 req-13725f14-f0b6-466b-8217-dcb792a866d2 service nova] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2809b8da-a810-45a2-85c0-1de08d661a13 req-13725f14-f0b6-466b-8217-dcb792a866d2 service nova] Lock "6707cbc8-a675-4248-b324-40630ebff478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2809b8da-a810-45a2-85c0-1de08d661a13 req-13725f14-f0b6-466b-8217-dcb792a866d2 service nova] Lock "6707cbc8-a675-4248-b324-40630ebff478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-2809b8da-a810-45a2-85c0-1de08d661a13 req-13725f14-f0b6-466b-8217-dcb792a866d2 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] No waiting events found dispatching network-vif-plugged-a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:31 user nova-compute[72447]: WARNING nova.compute.manager [req-2809b8da-a810-45a2-85c0-1de08d661a13 req-13725f14-f0b6-466b-8217-dcb792a866d2 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Received unexpected event network-vif-plugged-a880d610-9f14-4c6b-9326-35e1acfadce9 for instance with vm_state building and task_state spawning.
Jul 31 12:31:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:32 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Instance destroyed successfully.
Jul 31 12:31:32 user nova-compute[72447]: DEBUG nova.objects.instance [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'resources' on Instance uuid 2a481721-232b-4a4d-83ad-cfbac144bb5e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-13195892',display_name='tempest-ServerActionsTestOtherA-server-13195892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-13195892',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWDGihKbMeCNvBwsaW6V6P8R5lowbGENHMAc92pWv6O2vQFLobOnEOvb/OjxIDRXej4CqXst6J0oTtwIiGi8MF4pETlYJBg2aTwKoMBAuzDXV9HfutMu8dkCAol0vT0Q==',key_name='tempest-keypair-1212175094',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25afa936e9674cce91443f7bef7409ab',ramdisk_id='',reservation_id='r-lnqp7hno',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1904418117',owner_user_name='tempest-ServerActionsTestOtherA-1904418117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfd7290fb1a45b7a27cfb5faa08cc5d',uuid=2a481721-232b-4a4d-83ad-cfbac144bb5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converting VIF {"id": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "address": "fa:16:3e:cd:ae:8c", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1cb45da-a3", "ovs_interfaceid": "b1cb45da-a35d-45d4-90a1-031caf0f3c84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_vif [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1cb45da-a3, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:32 user nova-compute[72447]: INFO os_vif [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:ae:8c,bridge_name='br-int',has_traffic_filtering=True,id=b1cb45da-a35d-45d4-90a1-031caf0f3c84,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1cb45da-a3')
Jul 31 12:31:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQxtpKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:31:32 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e262e8e5-247d-480c-8df7-cc3e42bc90ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7890d260-fe3b-4467-acd1-3983fad27e7c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:31:32 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:31:32 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:31:32 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:31:32 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:31:32 user nova-compute[72447]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 (non-flash)
Jul 31 12:31:32 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:31:32 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:31:32 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0668106dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aea928-43e0-41d0-a87d-1dd4e8cd6412]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[298afee9-86fb-4465-9763-947a7b31dfe8]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb9d230-7e6e-4014-a156-fb9c85105556]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d08a33-5d75-47fc-a2ed-285d578c9c73]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[036b9525-880b-4a7d-be26-835f3ca984d5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c0199f-3f4d-4149-b2c0-b41708ac34de]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260]
Jul 31 12:31:32 user nova-compute[72447]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351, portal: 172.16.0.220,3260] successful.
Jul 31 12:31:32 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96012daf-491b-4fec-be48-6beaf6b1d351 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e48fc14-5aea-49da-ae8f-226d97013909]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] <== disconnect_volume: return (362ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:31:32 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Deleting instance files /opt/stack/data/nova/instances/2a481721-232b-4a4d-83ad-cfbac144bb5e_del
Jul 31 12:31:32 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Deletion of /opt/stack/data/nova/instances/2a481721-232b-4a4d-83ad-cfbac144bb5e_del complete
Jul 31 12:31:32 user nova-compute[72447]: INFO nova.compute.manager [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Took 1.31 seconds to destroy the instance on the hypervisor.
Jul 31 12:31:32 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:31:32 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806693.4224527, 6707cbc8-a675-4248-b324-40630ebff478 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:31:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6707cbc8-a675-4248-b324-40630ebff478] VM Resumed (Lifecycle Event)
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:31:33 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Instance spawned successfully.
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:31:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6707cbc8-a675-4248-b324-40630ebff478] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806693.4226763, 6707cbc8-a675-4248-b324-40630ebff478 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:31:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6707cbc8-a675-4248-b324-40630ebff478] VM Started (Lifecycle Event)
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:31:33 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 6707cbc8-a675-4248-b324-40630ebff478] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:31:33 user nova-compute[72447]: INFO nova.compute.manager [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Took 5.90 seconds to spawn the instance on the hypervisor.
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Received event network-vif-plugged-a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] Lock "6707cbc8-a675-4248-b324-40630ebff478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] Lock "6707cbc8-a675-4248-b324-40630ebff478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] No waiting events found dispatching network-vif-plugged-a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:33 user nova-compute[72447]: WARNING nova.compute.manager [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Received unexpected event network-vif-plugged-a880d610-9f14-4c6b-9326-35e1acfadce9 for instance with vm_state active and task_state None.
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received event network-vif-unplugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] No waiting events found dispatching network-vif-unplugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received event network-vif-unplugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received event network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] Acquiring lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] No waiting events found dispatching network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:33 user nova-compute[72447]: WARNING nova.compute.manager [req-05a719a7-04b5-4144-afdc-7672ed1353f6 req-31b61981-336a-44c6-97c7-97e5030bff3c service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received unexpected event network-vif-plugged-b1cb45da-a35d-45d4-90a1-031caf0f3c84 for instance with vm_state active and task_state deleting.
Jul 31 12:31:33 user nova-compute[72447]: INFO nova.compute.manager [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Took 6.66 seconds to build instance.
Jul 31 12:31:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-039371ba-b882-4aa7-9bc7-d8f926eb0e5c tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.768s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:34 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:31:34 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Took 1.48 seconds to deallocate network for instance.
Jul 31 12:31:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-61fe8b5c-a233-46e9-99e8-d55c7e449426 req-cd1c7110-70a6-456a-aa9d-f818245261b0 service nova] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Received event network-vif-deleted-b1cb45da-a35d-45d4-90a1-031caf0f3c84 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:34 user nova-compute[72447]: INFO nova.compute.manager [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Took 0.79 seconds to detach 1 volumes for instance.
Jul 31 12:31:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Deleting volume: 96012daf-491b-4fec-be48-6beaf6b1d351 {{(pid=72447) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 12:31:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:35 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:31:35 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:31:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:35 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Deleted allocations for instance 2a481721-232b-4a4d-83ad-cfbac144bb5e
Jul 31 12:31:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-72274ce1-a045-440b-9db0-e70e6b4eb032 tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "2a481721-232b-4a4d-83ad-cfbac144bb5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.301s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:45 user nova-compute[72447]: INFO nova.compute.manager [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] instance snapshotting
Jul 31 12:31:45 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Beginning live snapshot process
Jul 31 12:31:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json -f qcow2 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json -f qcow2 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf09h31lo/f0607321ed8446be83e444458ea17029.delta 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf09h31lo/f0607321ed8446be83e444458ea17029.delta 1073741824" returned: 0 in 0.049s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 12:31:47 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806692.1016686, 2a481721-232b-4a4d-83ad-cfbac144bb5e => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:31:47 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] VM Stopped (Lifecycle Event)
Jul 31 12:31:47 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9cb62c2b-e125-4158-911e-8d77067e606d None None] [instance: 2a481721-232b-4a4d-83ad-cfbac144bb5e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:31:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:31:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] COPY block job progress, current cursor: 27131904 final cursor: 75563008 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:31:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72447) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 12:31:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 12:31:48 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:31:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf09h31lo/f0607321ed8446be83e444458ea17029.delta /opt/stack/data/nova/instances/snapshots/tmpf09h31lo/f0607321ed8446be83e444458ea17029 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf09h31lo/f0607321ed8446be83e444458ea17029.delta /opt/stack/data/nova/instances/snapshots/tmpf09h31lo/f0607321ed8446be83e444458ea17029" returned: 0 in 0.316s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Snapshot extracted, beginning image upload
Jul 31 12:31:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:51 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Snapshot image upload complete
Jul 31 12:31:51 user nova-compute[72447]: INFO nova.compute.manager [None req-5c74daf0-85f8-45f4-859b-08c5654befc2 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Took 5.24 seconds to snapshot the instance on the hypervisor.
Jul 31 12:31:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "fdcbf76f-3148-43f5-9c10-358ab668096d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:53 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:31:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:53 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:31:53 user nova-compute[72447]: INFO nova.compute.claims [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Claim successful on node user
Jul 31 12:31:54 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:31:54 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:31:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:31:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:31:54 user nova-compute[72447]: DEBUG nova.network.neutron [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:31:54 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:31:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:31:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:31:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:31:54 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Creating image(s)
Jul 31 12:31:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "/opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "/opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "53b1abe6c13ef1c1cef022d1e740ba5fba14f64e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "53b1abe6c13ef1c1cef022d1e740ba5fba14f64e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:54 user nova-compute[72447]: DEBUG nova.policy [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55651d199ea94f2085d7f2950da100f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fef08187154b7da8fc1af9e8960a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:31:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e.part --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e.part --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:55 user nova-compute[72447]: DEBUG nova.virt.images [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] 64000c41-0014-41a4-b1ff-039785a74893 was qcow2, converting to raw {{(pid=72447) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 12:31:55 user nova-compute[72447]: DEBUG nova.privsep.utils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72447) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 12:31:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e.part /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e.converted {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e.part /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e.converted" returned: 0 in 0.677s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e.converted --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "53b1abe6c13ef1c1cef022d1e740ba5fba14f64e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.832s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG nova.network.neutron [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Successfully created port: 148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e --force-share --output=json" returned: 0 in 0.183s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "53b1abe6c13ef1c1cef022d1e740ba5fba14f64e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "53b1abe6c13ef1c1cef022d1e740ba5fba14f64e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e --force-share --output=json" returned: 0 in 0.175s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e,backing_fmt=raw /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e,backing_fmt=raw /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk 1073741824" returned: 0 in 0.065s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "53b1abe6c13ef1c1cef022d1e740ba5fba14f64e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lazy-loading 'migration_context' on Instance uuid fdcbf76f-3148-43f5-9c10-358ab668096d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Ensure instance console log exists: /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.network.neutron [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Successfully updated port: 148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "refresh_cache-fdcbf76f-3148-43f5-9c10-358ab668096d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquired lock "refresh_cache-fdcbf76f-3148-43f5-9c10-358ab668096d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.network.neutron [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-219e123d-d721-41ce-8c81-ca1f36fb5371 req-f24a6559-9d01-45f6-9280-9f68aa8c64b1 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Received event network-changed-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-219e123d-d721-41ce-8c81-ca1f36fb5371 req-f24a6559-9d01-45f6-9280-9f68aa8c64b1 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Refreshing instance network info cache due to event network-changed-148f60a6-1d5e-4b9b-9f8c-f199bb48f252. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-219e123d-d721-41ce-8c81-ca1f36fb5371 req-f24a6559-9d01-45f6-9280-9f68aa8c64b1 service nova] Acquiring lock "refresh_cache-fdcbf76f-3148-43f5-9c10-358ab668096d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.network.neutron [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.network.neutron [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Updating instance_info_cache with network_info: [{"id": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "address": "fa:16:3e:b5:b6:a8", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148f60a6-1d", "ovs_interfaceid": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Releasing lock "refresh_cache-fdcbf76f-3148-43f5-9c10-358ab668096d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Instance network_info: |[{"id": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "address": "fa:16:3e:b5:b6:a8", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148f60a6-1d", "ovs_interfaceid": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-219e123d-d721-41ce-8c81-ca1f36fb5371 req-f24a6559-9d01-45f6-9280-9f68aa8c64b1 service nova] Acquired lock "refresh_cache-fdcbf76f-3148-43f5-9c10-358ab668096d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.network.neutron [req-219e123d-d721-41ce-8c81-ca1f36fb5371 req-f24a6559-9d01-45f6-9280-9f68aa8c64b1 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Refreshing network info cache for port 148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Start _get_guest_xml network_info=[{"id": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "address": "fa:16:3e:b5:b6:a8", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148f60a6-1d", "ovs_interfaceid": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e692ed008e6b621ed259ea6d7542cdb0',container_format='bare',created_at=2023-07-31T12:31:46Z,direct_url=<?>,disk_format='qcow2',id=64000c41-0014-41a4-b1ff-039785a74893,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-374259682',owner='20fef08187154b7da8fc1af9e8960a1b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T12:31:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '64000c41-0014-41a4-b1ff-039785a74893'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:31:57 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:31:57 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e692ed008e6b621ed259ea6d7542cdb0',container_format='bare',created_at=2023-07-31T12:31:46Z,direct_url=<?>,disk_format='qcow2',id=64000c41-0014-41a4-b1ff-039785a74893,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-374259682',owner='20fef08187154b7da8fc1af9e8960a1b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T12:31:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1727105472',display_name='tempest-TestStampPattern-server-1727105472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1727105472',id=43,image_ref='64000c41-0014-41a4-b1ff-039785a74893',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyqS6WM/VxoajJCxkzqFbYmyaWdRi6cEk7Qi4JAyZ2mMuFpcq2L/28ah02VGBE9ktZbXYHxyezmKduAO5nTjd+L4At4n2ckFxT9WdPLRl0ZpDmeip6oN8T4/B1+t44T7g==',key_name='tempest-TestStampPattern-2046413804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20fef08187154b7da8fc1af9e8960a1b',ramdisk_id='',reservation_id='r-tps3tq49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d4bd5550-6cd3-4177-afbd-1e4981eeec99',image_min_disk='1',image_min_ram='0',image_owner_id='20fef08187154b7da8fc1af9e8960a1b',image_owner_project_name='tempest-TestStampPattern-1760569238',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1760569238-project-member',image_user_id='55651d199ea94f2085d7f2950da100f9',network_allocated='True',owner_project_name='tempest-TestStampPattern-1760569238',owner_user_name='tempest-TestStampPattern-1760569238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:31:54Z,user_data=None,user_id='55651d199ea94f2085d7f2950da100f9',uuid=fdcbf76f-3148-43f5-9c10-358ab668096d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "address": "fa:16:3e:b5:b6:a8", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148f60a6-1d", "ovs_interfaceid": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Converting VIF {"id": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "address": "fa:16:3e:b5:b6:a8", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148f60a6-1d", "ovs_interfaceid": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b6:a8,bridge_name='br-int',has_traffic_filtering=True,id=148f60a6-1d5e-4b9b-9f8c-f199bb48f252,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148f60a6-1d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lazy-loading 'pci_devices' on Instance uuid fdcbf76f-3148-43f5-9c10-358ab668096d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:31:57 user nova-compute[72447]:   <uuid>fdcbf76f-3148-43f5-9c10-358ab668096d</uuid>
Jul 31 12:31:57 user nova-compute[72447]:   <name>instance-0000002b</name>
Jul 31 12:31:57 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:31:57 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:31:57 user nova-compute[72447]:   <metadata>
Jul 31 12:31:57 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:31:57 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:31:57 user nova-compute[72447]:       <nova:name>tempest-TestStampPattern-server-1727105472</nova:name>
Jul 31 12:31:57 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:31:57</nova:creationTime>
Jul 31 12:31:57 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:31:57 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:31:57 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:31:57 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:31:57 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:31:57 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:31:57 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:31:57 user nova-compute[72447]:       <nova:owner>
Jul 31 12:31:57 user nova-compute[72447]:         <nova:user uuid="55651d199ea94f2085d7f2950da100f9">tempest-TestStampPattern-1760569238-project-member</nova:user>
Jul 31 12:31:57 user nova-compute[72447]:         <nova:project uuid="20fef08187154b7da8fc1af9e8960a1b">tempest-TestStampPattern-1760569238</nova:project>
Jul 31 12:31:57 user nova-compute[72447]:       </nova:owner>
Jul 31 12:31:57 user nova-compute[72447]:       <nova:root type="image" uuid="64000c41-0014-41a4-b1ff-039785a74893"/>
Jul 31 12:31:57 user nova-compute[72447]:       <nova:ports>
Jul 31 12:31:57 user nova-compute[72447]:         <nova:port uuid="148f60a6-1d5e-4b9b-9f8c-f199bb48f252">
Jul 31 12:31:57 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 12:31:57 user nova-compute[72447]:         </nova:port>
Jul 31 12:31:57 user nova-compute[72447]:       </nova:ports>
Jul 31 12:31:57 user nova-compute[72447]:     </nova:instance>
Jul 31 12:31:57 user nova-compute[72447]:   </metadata>
Jul 31 12:31:57 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:31:57 user nova-compute[72447]:     <system>
Jul 31 12:31:57 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:31:57 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:31:57 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:31:57 user nova-compute[72447]:       <entry name="serial">fdcbf76f-3148-43f5-9c10-358ab668096d</entry>
Jul 31 12:31:57 user nova-compute[72447]:       <entry name="uuid">fdcbf76f-3148-43f5-9c10-358ab668096d</entry>
Jul 31 12:31:57 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:31:57 user nova-compute[72447]:     </system>
Jul 31 12:31:57 user nova-compute[72447]:   </sysinfo>
Jul 31 12:31:57 user nova-compute[72447]:   <os>
Jul 31 12:31:57 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:31:57 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:31:57 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:31:57 user nova-compute[72447]:   </os>
Jul 31 12:31:57 user nova-compute[72447]:   <features>
Jul 31 12:31:57 user nova-compute[72447]:     <acpi/>
Jul 31 12:31:57 user nova-compute[72447]:     <apic/>
Jul 31 12:31:57 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:31:57 user nova-compute[72447]:   </features>
Jul 31 12:31:57 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:31:57 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:31:57 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:31:57 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:31:57 user nova-compute[72447]:   </clock>
Jul 31 12:31:57 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:31:57 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:31:57 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:31:57 user nova-compute[72447]:   </cpu>
Jul 31 12:31:57 user nova-compute[72447]:   <devices>
Jul 31 12:31:57 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:31:57 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:31:57 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk"/>
Jul 31 12:31:57 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:31:57 user nova-compute[72447]:     </disk>
Jul 31 12:31:57 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:31:57 user nova-compute[72447]:       <mac address="fa:16:3e:b5:b6:a8"/>
Jul 31 12:31:57 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:31:57 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:31:57 user nova-compute[72447]:       <target dev="tap148f60a6-1d"/>
Jul 31 12:31:57 user nova-compute[72447]:     </interface>
Jul 31 12:31:57 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:31:57 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/console.log" append="off"/>
Jul 31 12:31:57 user nova-compute[72447]:     </serial>
Jul 31 12:31:57 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:31:57 user nova-compute[72447]:     <video>
Jul 31 12:31:57 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:31:57 user nova-compute[72447]:     </video>
Jul 31 12:31:57 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:31:57 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:31:57 user nova-compute[72447]:     </rng>
Jul 31 12:31:57 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:31:57 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:31:57 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:31:57 user nova-compute[72447]:     </memballoon>
Jul 31 12:31:57 user nova-compute[72447]:   </devices>
Jul 31 12:31:57 user nova-compute[72447]: </domain>
Jul 31 12:31:57 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1727105472',display_name='tempest-TestStampPattern-server-1727105472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1727105472',id=43,image_ref='64000c41-0014-41a4-b1ff-039785a74893',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyqS6WM/VxoajJCxkzqFbYmyaWdRi6cEk7Qi4JAyZ2mMuFpcq2L/28ah02VGBE9ktZbXYHxyezmKduAO5nTjd+L4At4n2ckFxT9WdPLRl0ZpDmeip6oN8T4/B1+t44T7g==',key_name='tempest-TestStampPattern-2046413804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20fef08187154b7da8fc1af9e8960a1b',ramdisk_id='',reservation_id='r-tps3tq49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d4bd5550-6cd3-4177-afbd-1e4981eeec99',image_min_disk='1',image_min_ram='0',image_owner_id='20fef08187154b7da8fc1af9e8960a1b',image_owner_project_name='tempest-TestStampPattern-1760569238',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1760569238-project-member',image_user_id='55651d199ea94f2085d7f2950da100f9',network_allocated='True',owner_project_name='tempest-TestStampPattern-1760569238',owner_user_name='tempest-TestStampPattern-1760569238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:31:54Z,user_data=None,user_id='55651d199ea94f2085d7f2950da100f9',uuid=fdcbf76f-3148-43f5-9c10-358ab668096d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "address": "fa:16:3e:b5:b6:a8", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148f60a6-1d", "ovs_interfaceid": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Converting VIF {"id": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "address": "fa:16:3e:b5:b6:a8", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148f60a6-1d", "ovs_interfaceid": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b6:a8,bridge_name='br-int',has_traffic_filtering=True,id=148f60a6-1d5e-4b9b-9f8c-f199bb48f252,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148f60a6-1d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG os_vif [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b6:a8,bridge_name='br-int',has_traffic_filtering=True,id=148f60a6-1d5e-4b9b-9f8c-f199bb48f252,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148f60a6-1d') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap148f60a6-1d, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap148f60a6-1d, col_values=(('external_ids', {'iface-id': '148f60a6-1d5e-4b9b-9f8c-f199bb48f252', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:b6:a8', 'vm-uuid': 'fdcbf76f-3148-43f5-9c10-358ab668096d'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:57 user nova-compute[72447]: INFO os_vif [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b6:a8,bridge_name='br-int',has_traffic_filtering=True,id=148f60a6-1d5e-4b9b-9f8c-f199bb48f252,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148f60a6-1d')
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:31:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] No VIF found with MAC fa:16:3e:b5:b6:a8, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:31:58 user nova-compute[72447]: DEBUG nova.network.neutron [req-219e123d-d721-41ce-8c81-ca1f36fb5371 req-f24a6559-9d01-45f6-9280-9f68aa8c64b1 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Updated VIF entry in instance network info cache for port 148f60a6-1d5e-4b9b-9f8c-f199bb48f252. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:31:58 user nova-compute[72447]: DEBUG nova.network.neutron [req-219e123d-d721-41ce-8c81-ca1f36fb5371 req-f24a6559-9d01-45f6-9280-9f68aa8c64b1 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Updating instance_info_cache with network_info: [{"id": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "address": "fa:16:3e:b5:b6:a8", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148f60a6-1d", "ovs_interfaceid": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:31:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-219e123d-d721-41ce-8c81-ca1f36fb5371 req-f24a6559-9d01-45f6-9280-9f68aa8c64b1 service nova] Releasing lock "refresh_cache-fdcbf76f-3148-43f5-9c10-358ab668096d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:31:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:31:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-f190afac-6d9d-490b-943b-e5058390a3f4 req-002ff82a-02d2-402a-aa2f-c938e5a301c4 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Received event network-vif-plugged-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:31:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f190afac-6d9d-490b-943b-e5058390a3f4 req-002ff82a-02d2-402a-aa2f-c938e5a301c4 service nova] Acquiring lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:31:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f190afac-6d9d-490b-943b-e5058390a3f4 req-002ff82a-02d2-402a-aa2f-c938e5a301c4 service nova] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:31:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-f190afac-6d9d-490b-943b-e5058390a3f4 req-002ff82a-02d2-402a-aa2f-c938e5a301c4 service nova] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:31:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-f190afac-6d9d-490b-943b-e5058390a3f4 req-002ff82a-02d2-402a-aa2f-c938e5a301c4 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] No waiting events found dispatching network-vif-plugged-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:31:59 user nova-compute[72447]: WARNING nova.compute.manager [req-f190afac-6d9d-490b-943b-e5058390a3f4 req-002ff82a-02d2-402a-aa2f-c938e5a301c4 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Received unexpected event network-vif-plugged-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 for instance with vm_state building and task_state spawning.
Jul 31 12:32:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806721.302645, fdcbf76f-3148-43f5-9c10-358ab668096d => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:32:01 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] VM Resumed (Lifecycle Event)
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:32:01 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Instance spawned successfully.
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:32:01 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806721.302761, fdcbf76f-3148-43f5-9c10-358ab668096d => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:32:01 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] VM Started (Lifecycle Event)
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:32:01 user nova-compute[72447]: INFO nova.compute.manager [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Took 6.93 seconds to spawn the instance on the hypervisor.
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:32:01 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:32:01 user nova-compute[72447]: INFO nova.compute.manager [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Took 7.68 seconds to build instance.
Jul 31 12:32:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e2c805e-9094-4424-bb6b-a172699f510c tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.791s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.compute.manager [req-79906a99-e366-440b-9285-85a729042fd2 req-0be9d08e-1705-4898-8bb1-926f34848112 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Received event network-vif-plugged-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-79906a99-e366-440b-9285-85a729042fd2 req-0be9d08e-1705-4898-8bb1-926f34848112 service nova] Acquiring lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-79906a99-e366-440b-9285-85a729042fd2 req-0be9d08e-1705-4898-8bb1-926f34848112 service nova] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-79906a99-e366-440b-9285-85a729042fd2 req-0be9d08e-1705-4898-8bb1-926f34848112 service nova] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:01 user nova-compute[72447]: DEBUG nova.compute.manager [req-79906a99-e366-440b-9285-85a729042fd2 req-0be9d08e-1705-4898-8bb1-926f34848112 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] No waiting events found dispatching network-vif-plugged-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:32:01 user nova-compute[72447]: WARNING nova.compute.manager [req-79906a99-e366-440b-9285-85a729042fd2 req-0be9d08e-1705-4898-8bb1-926f34848112 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Received unexpected event network-vif-plugged-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 for instance with vm_state active and task_state None.
Jul 31 12:32:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-e464b485-641e-4be8-9b61-618db757c036 req-3b090a2b-711f-4740-8748-73d803b39952 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Received event network-changed-5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:32:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-e464b485-641e-4be8-9b61-618db757c036 req-3b090a2b-711f-4740-8748-73d803b39952 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Refreshing instance network info cache due to event network-changed-5b8d4302-80bf-4360-bb21-2e287c5732dd. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:32:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e464b485-641e-4be8-9b61-618db757c036 req-3b090a2b-711f-4740-8748-73d803b39952 service nova] Acquiring lock "refresh_cache-48e13eb4-f1e9-415d-8167-1ab683d1680e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:32:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e464b485-641e-4be8-9b61-618db757c036 req-3b090a2b-711f-4740-8748-73d803b39952 service nova] Acquired lock "refresh_cache-48e13eb4-f1e9-415d-8167-1ab683d1680e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:32:02 user nova-compute[72447]: DEBUG nova.network.neutron [req-e464b485-641e-4be8-9b61-618db757c036 req-3b090a2b-711f-4740-8748-73d803b39952 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Refreshing network info cache for port 5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:32:02 user nova-compute[72447]: DEBUG nova.network.neutron [req-e464b485-641e-4be8-9b61-618db757c036 req-3b090a2b-711f-4740-8748-73d803b39952 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Updated VIF entry in instance network info cache for port 5b8d4302-80bf-4360-bb21-2e287c5732dd. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:32:02 user nova-compute[72447]: DEBUG nova.network.neutron [req-e464b485-641e-4be8-9b61-618db757c036 req-3b090a2b-711f-4740-8748-73d803b39952 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Updating instance_info_cache with network_info: [{"id": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "address": "fa:16:3e:63:69:0e", "network": {"id": "f7ca946a-7d88-4acb-ba32-111edd4250db", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264876345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33c6b4b34cf749a488dc865c1662a22e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8d4302-80", "ovs_interfaceid": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:32:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e464b485-641e-4be8-9b61-618db757c036 req-3b090a2b-711f-4740-8748-73d803b39952 service nova] Releasing lock "refresh_cache-48e13eb4-f1e9-415d-8167-1ab683d1680e" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:32:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lazy-loading 'flavor' on Instance uuid 48e13eb4-f1e9-415d-8167-1ab683d1680e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:04 user nova-compute[72447]: INFO nova.compute.manager [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Attaching volume 74cc0cd0-af58-4854-9881-e9be36c20422 to /dev/vdb
Jul 31 12:32:04 user nova-compute[72447]: DEBUG os_brick.utils [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0775a63c-b772-4b5a-806c-f4a4ff7e8730]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6a25e8-024a-49ee-a525-e1fb35a4054f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b420d-5756-431b-aeea-ed7365a8249c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef64eb74-be26-434d-8273-7dfab250d105]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:32:04 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6662f0f0-e938-40f1-96ca-f6797ed196fd]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG os_brick.utils [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Updating existing volume attachment record: e1a743d8-b5af-40f6-97ab-45c5095e0f9a {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Updating instance_info_cache with network_info: [{"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-0dbd2353-0521-4e92-8722-6151bfb40924" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:32:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72447) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 12:32:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:06 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:32:07 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:32:07 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:32:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpVbOYXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:32:12 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:32:12 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:32:12 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3007e8d-fb52-479e-9d16-4cc7bf353215]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:32:12 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4025343e-ffd1-4759-803f-a6df0fce2f88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422] added
Jul 31 12:32:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fba521-31b8-4a3a-8f6c-3fc5de8e6324]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef12eb6a-c846-42d1-8751-f97aa799a9b9]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpVbOYXj {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpVbOYXj" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fcc808-7c46-4da6-b622-9b0d016fc66c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zpVbOYXj'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2592f8-51f9-4ad7-856a-8273b26e0e3e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3106d0-5ca5-44c8-b2f5-acebe012467f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:32:12 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:32:12 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:32:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:32:12 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:32:12 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:32:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa7c396-77a3-427d-8188-d4572a8b7a47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422, portal: 172.16.0.220,3260]
Jul 31 12:32:12 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422, portal: 172.16.0.220,3260] successful.
Jul 31 12:32:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e5a119-0806-4543-b175-81b03506690a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b91a2f6-e25a-4ff9-a5b2-ceda8901d632]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:32:12 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:32:12 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:32:12 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:32:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:32:12 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:32:12 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:32:12 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:32:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9364ab34-c85d-451d-838d-3662d2d90536]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpVbOYXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26564383238353732', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564383238353732', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG nova.objects.instance [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lazy-loading 'flavor' on Instance uuid 48e13eb4-f1e9-415d-8167-1ab683d1680e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:32:13 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:32:13 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:32:13 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:32:13 user nova-compute[72447]:   <serial>74cc0cd0-af58-4854-9881-e9be36c20422</serial>
Jul 31 12:32:13 user nova-compute[72447]: </disk>
Jul 31 12:32:13 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] No VIF found with MAC fa:16:3e:63:69:0e, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:32:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-87539945-8451-4d44-8282-2e14a8f4cdb4 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.986s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:32:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:32:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7414MB free_disk=24.744922637939453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance f3f1534b-16c0-4dee-b78c-d53713113a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 48e13eb4-f1e9-415d-8167-1ab683d1680e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 8213834b-8f6f-45eb-a1b7-8ad0561ce275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6707cbc8-a675-4248-b324-40630ebff478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance fdcbf76f-3148-43f5-9c10-358ab668096d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing inventories for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating ProviderTree inventory for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 12:32:14 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing aggregate associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, aggregates: None {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 12:32:15 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing trait associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 12:32:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:15 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:32:15 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:32:15 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:32:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.658s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:32:15 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 12:32:15 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] There are 0 instances to clean {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 12:32:16 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:32:16 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:32:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:17 user nova-compute[72447]: DEBUG nova.objects.instance [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lazy-loading 'flavor' on Instance uuid 48e13eb4-f1e9-415d-8167-1ab683d1680e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:32:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:18 user nova-compute[72447]: INFO nova.compute.manager [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Attaching volume f769a89d-996a-48ae-a6b9-cf8f9a572286 to /dev/vdc
Jul 31 12:32:18 user nova-compute[72447]: DEBUG os_brick.utils [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65b9446-1f85-4a4a-b040-7ba3bdfd1a8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[57968f1e-136c-4bf8-a26c-1aa0ee06bc30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb96368-460f-4e61-bad4-c1ddf21c9740]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff5ad6f-5953-496d-9eae-7236dc0560fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:32:18 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:32:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6f4fca-1692-46fe-a633-5f18da3da470]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG os_brick.utils [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:32:18 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Updating existing volume attachment record: a6a9d087-8ca9-4975-8cdd-3bcf85e7bd14 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:32:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzwftVKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:32:25 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:32:25 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:32:25 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2d88e9-3d7b-4b75-8821-72098b437b62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:32:25 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc3ea71-de72-452e-b5c1-69bddc594289]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286] added
Jul 31 12:32:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6759b9e0-24c4-4b71-ab6e-a1755513b1f9]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[de39ca9f-f80f-4393-af37-31a7f2f9258d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QzwftVKM {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QzwftVKM" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f953621-9ed6-410b-b1e3-84c1b30a0343]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QzwftVKM'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6c60e5-a821-473b-9919-eaf2a662fe6d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[232ec1fb-d626-45f9-966e-955efbaa3419]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:32:25 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:32:25 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:32:25 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:32:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:32:25 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:32:25 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:32:25 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:32:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3914d0-b0c5-4be4-b53a-196a945862fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286, portal: 172.16.0.220,3260]
Jul 31 12:32:25 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286, portal: 172.16.0.220,3260] successful.
Jul 31 12:32:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d71dd2-c208-4125-9cef-86d35cf23b22]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[46898044-62bf-4800-9fc5-f710e1df8bd9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:32:26 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:32:26 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:32:26 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:32:26 user nova-compute[72447]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 (non-flash)
Jul 31 12:32:26 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:32:26 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:32:26 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:32:26 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:32:26 user nova-compute[72447]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 (non-flash)
Jul 31 12:32:26 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec748ca-a241-4203-a0b1-d14c7b6ff96d]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzwftVKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:26 user nova-compute[72447]: INFO nova.compute.manager [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Terminating instance
Jul 31 12:32:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26465626131633761', 'path': '/dev/sdf'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465626131633761', 'path': '/dev/sdf'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.objects.instance [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lazy-loading 'flavor' on Instance uuid 48e13eb4-f1e9-415d-8167-1ab683d1680e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:32:27 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:32:27 user nova-compute[72447]:   <source dev="/dev/sdf"/>
Jul 31 12:32:27 user nova-compute[72447]:   <target dev="vdc" bus="virtio"/>
Jul 31 12:32:27 user nova-compute[72447]:   <serial>f769a89d-996a-48ae-a6b9-cf8f9a572286</serial>
Jul 31 12:32:27 user nova-compute[72447]: </disk>
Jul 31 12:32:27 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-77276126-aed9-412f-b3ab-4157b8b7b004 req-8552305c-f8b7-489e-b21d-9d6549d459de service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-vif-unplugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-77276126-aed9-412f-b3ab-4157b8b7b004 req-8552305c-f8b7-489e-b21d-9d6549d459de service nova] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-77276126-aed9-412f-b3ab-4157b8b7b004 req-8552305c-f8b7-489e-b21d-9d6549d459de service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-77276126-aed9-412f-b3ab-4157b8b7b004 req-8552305c-f8b7-489e-b21d-9d6549d459de service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-77276126-aed9-412f-b3ab-4157b8b7b004 req-8552305c-f8b7-489e-b21d-9d6549d459de service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] No waiting events found dispatching network-vif-unplugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-77276126-aed9-412f-b3ab-4157b8b7b004 req-8552305c-f8b7-489e-b21d-9d6549d459de service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-vif-unplugged-fe243daf-4d07-48dd-84c9-1252c65085ed for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] No VIF found with MAC fa:16:3e:63:69:0e, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d90cc562-3f3a-477a-871f-c8afdcc64b80 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.638s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Instance destroyed successfully.
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.objects.instance [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lazy-loading 'resources' on Instance uuid 51310b38-96e0-4d44-ab1e-8d2cc039617e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-615647500',display_name='tempest-ServerActionsTestOtherA-server-1623510083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-615647500',id=16,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWDGihKbMeCNvBwsaW6V6P8R5lowbGENHMAc92pWv6O2vQFLobOnEOvb/OjxIDRXej4CqXst6J0oTtwIiGi8MF4pETlYJBg2aTwKoMBAuzDXV9HfutMu8dkCAol0vT0Q==',key_name='tempest-keypair-1212175094',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:20:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25afa936e9674cce91443f7bef7409ab',ramdisk_id='',reservation_id='r-9wvn7yz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1904418117',owner_user_name='tempest-ServerActionsTestOtherA-1904418117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:20:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfd7290fb1a45b7a27cfb5faa08cc5d',uuid=51310b38-96e0-4d44-ab1e-8d2cc039617e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converting VIF {"id": "fe243daf-4d07-48dd-84c9-1252c65085ed", "address": "fa:16:3e:8c:ca:e2", "network": {"id": "6c041742-8363-4aec-945e-7cbd5d4e7acf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2107779541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25afa936e9674cce91443f7bef7409ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe243daf-4d", "ovs_interfaceid": "fe243daf-4d07-48dd-84c9-1252c65085ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG os_vif [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe243daf-4d, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:32:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:27 user nova-compute[72447]: INFO os_vif [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ca:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe243daf-4d07-48dd-84c9-1252c65085ed,network=Network(6c041742-8363-4aec-945e-7cbd5d4e7acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe243daf-4d')
Jul 31 12:32:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Deleting instance files /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e_del
Jul 31 12:32:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Deletion of /opt/stack/data/nova/instances/51310b38-96e0-4d44-ab1e-8d2cc039617e_del complete
Jul 31 12:32:28 user nova-compute[72447]: INFO nova.compute.manager [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Took 1.26 seconds to destroy the instance on the hypervisor.
Jul 31 12:32:28 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:32:28 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:32:28 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:32:28 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:32:28 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Took 0.71 seconds to deallocate network for instance.
Jul 31 12:32:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-ebb185dc-b413-4c22-a2be-5fe6665a5d96 req-0a41e7f8-2385-4826-9d38-055346000b86 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-vif-deleted-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:32:28 user nova-compute[72447]: INFO nova.compute.manager [req-ebb185dc-b413-4c22-a2be-5fe6665a5d96 req-0a41e7f8-2385-4826-9d38-055346000b86 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Neutron deleted interface fe243daf-4d07-48dd-84c9-1252c65085ed; detaching it from the instance and deleting it from the info cache
Jul 31 12:32:28 user nova-compute[72447]: DEBUG nova.network.neutron [req-ebb185dc-b413-4c22-a2be-5fe6665a5d96 req-0a41e7f8-2385-4826-9d38-055346000b86 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:32:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-ebb185dc-b413-4c22-a2be-5fe6665a5d96 req-0a41e7f8-2385-4826-9d38-055346000b86 service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Detach interface failed, port_id=fe243daf-4d07-48dd-84c9-1252c65085ed, reason: Instance 51310b38-96e0-4d44-ab1e-8d2cc039617e could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:32:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:29 user nova-compute[72447]: INFO nova.compute.manager [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Detaching volume f769a89d-996a-48ae-a6b9-cf8f9a572286
Jul 31 12:32:29 user nova-compute[72447]: INFO nova.virt.block_device [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Attempting to driver detach volume f769a89d-996a-48ae-a6b9-cf8f9a572286 from mountpoint /dev/vdc
Jul 31 12:32:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Attempting to detach device vdc from instance 48e13eb4-f1e9-415d-8167-1ab683d1680e from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:32:29 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:32:29 user nova-compute[72447]:   <source dev="/dev/sdf"/>
Jul 31 12:32:29 user nova-compute[72447]:   <target dev="vdc" bus="virtio"/>
Jul 31 12:32:29 user nova-compute[72447]:   <serial>f769a89d-996a-48ae-a6b9-cf8f9a572286</serial>
Jul 31 12:32:29 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 12:32:29 user nova-compute[72447]: </disk>
Jul 31 12:32:29 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:32:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Successfully detached device vdc from instance 48e13eb4-f1e9-415d-8167-1ab683d1680e from the persistent domain config.
Jul 31 12:32:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 48e13eb4-f1e9-415d-8167-1ab683d1680e from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:32:29 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:32:29 user nova-compute[72447]:   <source dev="/dev/sdf"/>
Jul 31 12:32:29 user nova-compute[72447]:   <target dev="vdc" bus="virtio"/>
Jul 31 12:32:29 user nova-compute[72447]:   <serial>f769a89d-996a-48ae-a6b9-cf8f9a572286</serial>
Jul 31 12:32:29 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 12:32:29 user nova-compute[72447]: </disk>
Jul 31 12:32:29 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-3226bfcf-b2d1-4ba4-8cdc-6c8e0bb331cd req-92b5b04a-0bcd-4951-b74d-c7020732871b service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received event network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3226bfcf-b2d1-4ba4-8cdc-6c8e0bb331cd req-92b5b04a-0bcd-4951-b74d-c7020732871b service nova] Acquiring lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3226bfcf-b2d1-4ba4-8cdc-6c8e0bb331cd req-92b5b04a-0bcd-4951-b74d-c7020732871b service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3226bfcf-b2d1-4ba4-8cdc-6c8e0bb331cd req-92b5b04a-0bcd-4951-b74d-c7020732871b service nova] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-3226bfcf-b2d1-4ba4-8cdc-6c8e0bb331cd req-92b5b04a-0bcd-4951-b74d-c7020732871b service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] No waiting events found dispatching network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:32:29 user nova-compute[72447]: WARNING nova.compute.manager [req-3226bfcf-b2d1-4ba4-8cdc-6c8e0bb331cd req-92b5b04a-0bcd-4951-b74d-c7020732871b service nova] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Received unexpected event network-vif-plugged-fe243daf-4d07-48dd-84c9-1252c65085ed for instance with vm_state deleted and task_state None.
Jul 31 12:32:29 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:29 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Deleted allocations for instance 51310b38-96e0-4d44-ab1e-8d2cc039617e
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-00d80ee6-cca3-4384-b8ab-dff6e00b0e1b tempest-ServerActionsTestOtherA-1904418117 tempest-ServerActionsTestOtherA-1904418117-project-member] Lock "51310b38-96e0-4d44-ab1e-8d2cc039617e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.667s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806749.7106128, 48e13eb4-f1e9-415d-8167-1ab683d1680e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 48e13eb4-f1e9-415d-8167-1ab683d1680e {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:32:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Successfully detached device vdc from instance 48e13eb4-f1e9-415d-8167-1ab683d1680e from the live domain config.
Jul 31 12:32:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzwftVKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:32:29 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5796db45-b3fb-470c-925c-c42c6b4ec5cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e29a63-9d64-4b17-a617-c203ee2adc49]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:32:29 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:32:29 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:32:29 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:32:29 user nova-compute[72447]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 (non-flash)
Jul 31 12:32:29 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:32:29 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:32:29 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:32:29 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:32:29 user nova-compute[72447]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 (non-flash)
Jul 31 12:32:29 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0648791510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286'): ({'sdf'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Removing single pathed devices sdf {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c2b077-1b63-4d08-947b-764ca1393613]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25d15e6-6bb8-4475-8381-9c31722b2347]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Flushing IO for device /dev/sdf {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aa1451-4510-42e0-b1d5-378999f7ffbc]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f6bad2-c630-4252-8d07-b01c912ebc90]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] SCSI volumes sdf have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8a31fa-1a0f-43af-8f9c-9fc3bbc8c928]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[881d564f-d269-4035-b3d6-1e1d11b12b82]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286, portal: 172.16.0.220,3260]
Jul 31 12:32:29 user nova-compute[72447]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286, portal: 172.16.0.220,3260] successful.
Jul 31 12:32:29 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f769a89d-996a-48ae-a6b9-cf8f9a572286 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[197ce3e6-c2b2-4910-b6bd-b8a13e59e292]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:32:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] <== disconnect_volume: return (300ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:32:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:32:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:30 user nova-compute[72447]: DEBUG nova.objects.instance [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lazy-loading 'flavor' on Instance uuid 48e13eb4-f1e9-415d-8167-1ab683d1680e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:32:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ba4f06e2-efc6-42a6-9b91-8303cc77fc77 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.778s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:42 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806747.9116893, 51310b38-96e0-4d44-ab1e-8d2cc039617e => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:32:42 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] VM Stopped (Lifecycle Event)
Jul 31 12:32:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-81477792-74e2-4b70-b284-48e0d85aa3ea None None] [instance: 51310b38-96e0-4d44-ab1e-8d2cc039617e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:32:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:32:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:32:53 user nova-compute[72447]: DEBUG nova.compute.manager [req-62bcf44a-3afb-492d-8eea-9c5693be3327 req-324479ae-7fb4-4acc-b663-f8a71a5d3d1d service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Received event network-changed-77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:32:53 user nova-compute[72447]: DEBUG nova.compute.manager [req-62bcf44a-3afb-492d-8eea-9c5693be3327 req-324479ae-7fb4-4acc-b663-f8a71a5d3d1d service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Refreshing instance network info cache due to event network-changed-77c8b570-0995-4ad9-b741-5d4a8bdb8920. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:32:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-62bcf44a-3afb-492d-8eea-9c5693be3327 req-324479ae-7fb4-4acc-b663-f8a71a5d3d1d service nova] Acquiring lock "refresh_cache-8213834b-8f6f-45eb-a1b7-8ad0561ce275" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:32:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-62bcf44a-3afb-492d-8eea-9c5693be3327 req-324479ae-7fb4-4acc-b663-f8a71a5d3d1d service nova] Acquired lock "refresh_cache-8213834b-8f6f-45eb-a1b7-8ad0561ce275" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:32:53 user nova-compute[72447]: DEBUG nova.network.neutron [req-62bcf44a-3afb-492d-8eea-9c5693be3327 req-324479ae-7fb4-4acc-b663-f8a71a5d3d1d service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Refreshing network info cache for port 77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:32:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lazy-loading 'flavor' on Instance uuid 8213834b-8f6f-45eb-a1b7-8ad0561ce275 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:32:53 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Ignoring supplied device name: /dev/vdb
Jul 31 12:32:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:54 user nova-compute[72447]: INFO nova.compute.manager [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Attaching volume 0022934b-d5b7-42a1-92fe-389d8bba5804 to /dev/vdb
Jul 31 12:32:54 user nova-compute[72447]: DEBUG os_brick.utils [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cbfaa0-9872-4d13-a83d-221a08803f95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e33907f-2af7-4a45-8ba1-abf36a1cf76b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0675c776-7011-4152-aab8-63ca9f10ff10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9468445f-7334-4f53-86ee-522f1137bd6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG nova.network.neutron [req-62bcf44a-3afb-492d-8eea-9c5693be3327 req-324479ae-7fb4-4acc-b663-f8a71a5d3d1d service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Updated VIF entry in instance network info cache for port 77c8b570-0995-4ad9-b741-5d4a8bdb8920. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG nova.network.neutron [req-62bcf44a-3afb-492d-8eea-9c5693be3327 req-324479ae-7fb4-4acc-b663-f8a71a5d3d1d service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Updating instance_info_cache with network_info: [{"id": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "address": "fa:16:3e:63:eb:94", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c8b570-09", "ovs_interfaceid": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:32:54 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c128fc-cf52-4e15-aaa6-1dc7e6e09b1c]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG os_brick.utils [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Updating existing volume attachment record: 02bec419-8db1-4f36-a646-4f66d0c54f1e {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-62bcf44a-3afb-492d-8eea-9c5693be3327 req-324479ae-7fb4-4acc-b663-f8a71a5d3d1d service nova] Releasing lock "refresh_cache-8213834b-8f6f-45eb-a1b7-8ad0561ce275" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:54 user nova-compute[72447]: INFO nova.compute.manager [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Terminating instance
Jul 31 12:32:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG nova.compute.manager [req-658b5548-2fe0-4c52-9589-89ad7a38a574 req-ba89617e-0955-4b21-88b8-24be5415d185 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-unplugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-658b5548-2fe0-4c52-9589-89ad7a38a574 req-ba89617e-0955-4b21-88b8-24be5415d185 service nova] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-658b5548-2fe0-4c52-9589-89ad7a38a574 req-ba89617e-0955-4b21-88b8-24be5415d185 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-658b5548-2fe0-4c52-9589-89ad7a38a574 req-ba89617e-0955-4b21-88b8-24be5415d185 service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG nova.compute.manager [req-658b5548-2fe0-4c52-9589-89ad7a38a574 req-ba89617e-0955-4b21-88b8-24be5415d185 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] No waiting events found dispatching network-vif-unplugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG nova.compute.manager [req-658b5548-2fe0-4c52-9589-89ad7a38a574 req-ba89617e-0955-4b21-88b8-24be5415d185 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-unplugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:55 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Instance destroyed successfully.
Jul 31 12:32:55 user nova-compute[72447]: DEBUG nova.objects.instance [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'resources' on Instance uuid 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1891158354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1891158354',id=37,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-3c0dkf4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:31:10Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "address": "fa:16:3e:23:9c:86", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f2076d-50", "ovs_interfaceid": "82f2076d-509b-45d4-9ef3-cfc546e01a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:9c:86,bridge_name='br-int',has_traffic_filtering=True,id=82f2076d-509b-45d4-9ef3-cfc546e01a85,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f2076d-50') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG os_vif [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9c:86,bridge_name='br-int',has_traffic_filtering=True,id=82f2076d-509b-45d4-9ef3-cfc546e01a85,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f2076d-50') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82f2076d-50, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:32:55 user nova-compute[72447]: INFO os_vif [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9c:86,bridge_name='br-int',has_traffic_filtering=True,id=82f2076d-509b-45d4-9ef3-cfc546e01a85,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f2076d-50')
Jul 31 12:32:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRHOtSTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:32:55 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:32:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[951f0050-1dc3-4fef-8b09-04cf454a4aae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddea6b4-6474-413d-85ce-3f7986e9f915]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:32:55 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:32:55 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:32:55 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:32:55 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:32:55 user nova-compute[72447]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df (non-flash)
Jul 31 12:32:55 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:32:55 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:32:55 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06701377f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df'): ({'sdd'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Removing single pathed devices sdd {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d2445c-f19f-48f6-8b74-933fc52ca7d4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede8fe92-d403-4982-84e5-872110451d11]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flushing IO for device /dev/sdd {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:32:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad3e918-1586-4090-a954-ddf7ee24133c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b94cfa4-4672-4827-a9f6-27b0f1ca145e]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObf66b2da-10d24004ebc09c3f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bf66b2da', '/dev/disk/by-id/scsi-23130643234303034') {{(pid=83492) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddc8fcf-af46-4a35-8baa-8095c2485e98]: (4, None) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d59c4a-b642-4fe2-a063-ca04bd0da689]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f399c85e-3198-4a3d-bfb9-81956d8209cd]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df, portal: 172.16.0.220,3260]
Jul 31 12:32:56 user nova-compute[72447]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df, portal: 172.16.0.220,3260] successful.
Jul 31 12:32:56 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a5aa38-dc89-4b03-ac50-f5fba0e7b7df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4754e2-cb7a-4f6f-a690-1e5e0b8ea69f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] <== disconnect_volume: return (338ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:32:56 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Deleting instance files /opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0_del
Jul 31 12:32:56 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Deletion of /opt/stack/data/nova/instances/6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0_del complete
Jul 31 12:32:56 user nova-compute[72447]: INFO nova.compute.manager [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Took 1.34 seconds to destroy the instance on the hypervisor.
Jul 31 12:32:56 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:32:56 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:32:56 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Took 0.50 seconds to deallocate network for instance.
Jul 31 12:32:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-7edf4571-6be5-46e5-b899-9a175152c6b0 req-57ad75ba-6342-4cc5-973f-1b1125633a90 service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-deleted-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:32:57 user nova-compute[72447]: INFO nova.compute.manager [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Took 0.71 seconds to detach 1 volumes for instance.
Jul 31 12:32:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-429e38e7-2914-4e3f-ad7e-6853b3aa2cba req-c18a88b5-52cc-44dd-857c-5c985303a52c service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:32:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-429e38e7-2914-4e3f-ad7e-6853b3aa2cba req-c18a88b5-52cc-44dd-857c-5c985303a52c service nova] Acquiring lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-429e38e7-2914-4e3f-ad7e-6853b3aa2cba req-c18a88b5-52cc-44dd-857c-5c985303a52c service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-429e38e7-2914-4e3f-ad7e-6853b3aa2cba req-c18a88b5-52cc-44dd-857c-5c985303a52c service nova] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-429e38e7-2914-4e3f-ad7e-6853b3aa2cba req-c18a88b5-52cc-44dd-857c-5c985303a52c service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] No waiting events found dispatching network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:32:57 user nova-compute[72447]: WARNING nova.compute.manager [req-429e38e7-2914-4e3f-ad7e-6853b3aa2cba req-c18a88b5-52cc-44dd-857c-5c985303a52c service nova] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Received unexpected event network-vif-plugged-82f2076d-509b-45d4-9ef3-cfc546e01a85 for instance with vm_state active and task_state deleting.
Jul 31 12:32:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:32:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:32:57 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:32:57 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:32:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:32:58 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Deleted allocations for instance 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0
Jul 31 12:32:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ff25fcaf-acbd-408d-8498-295481d9c4b3 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.175s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:00 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:33:00 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:33:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquired lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:33:00 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:33:00 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'info_cache' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SETcWCys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:33:01 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:33:01 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:33:01 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7565779-9ccd-4ea6-91c1-a743342eeddc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:33:01 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a041762-4724-4a59-a5be-4ba19ee00fb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804] added
Jul 31 12:33:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG nova.network.neutron [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updating instance_info_cache with network_info: [{"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04aab59-d967-4786-9cb7-b1468da31ef4]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Releasing lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[460621e6-faa2-4dcf-802e-f7c9ad3882b5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SETcWCys {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:01 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance destroyed successfully.
Jul 31 12:33:01 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'resources' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:28:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-675334656',display_name='tempest-AttachVolumeTestJSON-server-675334656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-675334656',id=39,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjaiwoFel2Eh2TCakrkW9agvz+yoDwe/zWXpzkLHB0ZWZVJFVho0opNQvvQrNB2zUmhAKykfMwu2NDRbQKV/RDfX39Ice4f0JVuhVt96pRXbOIBk6k5FqAJVOMHKQRawg==',key_name='tempest-keypair-1537936122',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f7c1764cced4b49ad8e55759362a8db',ramdisk_id='',reservation_id='r-p6axrgt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-182433734',owner_user_name='tempest-AttachVolumeTestJSON-182433734-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:31:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33486507bb4141d1a1753054199bce56',uuid=43b9c1c3-280c-4c26-9435-e50d29b3d8d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converting VIF {"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_vif [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23148cca-e5, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:33:01 user nova-compute[72447]: INFO os_vif [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5')
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SETcWCys" returned: 0 in 0.038s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5866b055-10ea-4347-b3a6-d33fde0464b0]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SETcWCys'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKlaHuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:33:01 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbb177d-ee9a-4d5b-b0f1-cc5848dd9693]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81255f0-7c49-4b7d-a4ed-342dc15d2653]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e6c0a4-ae3f-4f75-918e-f1912cb9aa98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804, portal: 172.16.0.220,3260]
Jul 31 12:33:01 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804, portal: 172.16.0.220,3260] successful.
Jul 31 12:33:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a100930-d992-499f-b372-90bf5394e9f6]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde1a921-9451-4722-9755-6ee61977f3cd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)
Jul 31 12:33:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de0cb1c-9653-446c-b29d-55ba3f3653da]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:33:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SETcWCys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:33:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:33:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23937323633336565', 'path': '/dev/sdd'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:33:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937323633336565', 'path': '/dev/sdd'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:33:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.192s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:33:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:33:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:02 user nova-compute[72447]: DEBUG nova.objects.instance [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lazy-loading 'flavor' on Instance uuid 8213834b-8f6f-45eb-a1b7-8ad0561ce275 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:02 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a332758-edca-4f6c-aa46-cc270a4a257e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:02 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:33:02 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:33:02 user nova-compute[72447]:   <source dev="/dev/sdd"/>
Jul 31 12:33:02 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:33:02 user nova-compute[72447]:   <serial>0022934b-d5b7-42a1-92fe-389d8bba5804</serial>
Jul 31 12:33:02 user nova-compute[72447]: </disk>
Jul 31 12:33:02 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e4b51f-875e-49f9-9718-333f9b43cea2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0648716680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795'): ({'sde'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Removing single pathed devices sde {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[438ccf4d-02bb-48e1-a795-ae695c9d041b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[991db526-51ff-46d4-a688-621ea89cc852]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Flushing IO for device /dev/sde {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ffb4ca-0665-4c1f-969f-669e71774f5a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ed08fd-b085-4f9d-ab81-98be98e78fd2]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda17ffe-64f8-46c2-973b-93a7e42acac0]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb2d228-86b4-4167-84e4-1cf572831087]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260]
Jul 31 12:33:03 user nova-compute[72447]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260] successful.
Jul 31 12:33:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9900d63-9edc-4dc5-8df5-0b2c9a3592ec]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] <== disconnect_volume: return (1508ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Start _get_guest_xml network_info=[{"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '1255194e-1a2a-4fd3-bea7-ad7df752cf77', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKlaHuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '43b9c1c3-280c-4c26-9435-e50d29b3d8d6', 'attached_at': '', 'detached_at': '', 'volume_id': '9bb2e350-4c8b-4d57-9ca5-592d94123795', 'serial': '9bb2e350-4c8b-4d57-9ca5-592d94123795'}, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'numa_topology' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:03 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:33:03 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'vcpu_model' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKlaHuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:33:03 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:33:03 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:33:03 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aefcc85-a5d2-4bbe-8af7-c2e9d5187afc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:33:03 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] No VIF found with MAC fa:16:3e:63:eb:94, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e51f71-c858-466e-96f2-ec3e7dcb6fb4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795] added
Jul 31 12:33:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad181bf-b60f-4341-bd5b-3d99d0bf8609]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba4f60c-5b34-4e59-a990-af7839b6cc49]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrKlaHuD {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrKlaHuD" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9a4662-6ca5-44c2-a897-796753f45dea]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vrKlaHuD'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83cc4b4-6c0b-4c44-8fb0-1718485103c2]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-e55366dc-c401-4e27-afff-5ae7b3cff444 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.517s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf45ac29-5c53-452b-a2d0-df342d0c6768]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ac8d47-1822-4d92-bc03-4389d8abb293]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260]
Jul 31 12:33:03 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260] successful.
Jul 31 12:33:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db2895f-1f59-4e88-a0a2-fe432bf189d9]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41be3ef-5d92-419b-a9c6-b683b87d4e30]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:03 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a68f3c7-11f9-449a-8bc4-a0793457c2de]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:33:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKlaHuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:33:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:33:04 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23734666230356635', 'path': '/dev/sde'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:33:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734666230356635', 'path': '/dev/sde'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:33:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:28:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-675334656',display_name='tempest-AttachVolumeTestJSON-server-675334656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-675334656',id=39,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjaiwoFel2Eh2TCakrkW9agvz+yoDwe/zWXpzkLHB0ZWZVJFVho0opNQvvQrNB2zUmhAKykfMwu2NDRbQKV/RDfX39Ice4f0JVuhVt96pRXbOIBk6k5FqAJVOMHKQRawg==',key_name='tempest-keypair-1537936122',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f7c1764cced4b49ad8e55759362a8db',ramdisk_id='',reservation_id='r-p6axrgt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-182433734',owner_user_name='tempest-AttachVolumeTestJSON-182433734-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:31:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33486507bb4141d1a1753054199bce56',uuid=43b9c1c3-280c-4c26-9435-e50d29b3d8d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:33:04 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converting VIF {"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:33:04 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:33:04 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'pci_devices' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:33:04 user nova-compute[72447]:   <uuid>43b9c1c3-280c-4c26-9435-e50d29b3d8d6</uuid>
Jul 31 12:33:04 user nova-compute[72447]:   <name>instance-00000027</name>
Jul 31 12:33:04 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:33:04 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:33:04 user nova-compute[72447]:   <metadata>
Jul 31 12:33:04 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:33:04 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:33:04 user nova-compute[72447]:       <nova:name>tempest-AttachVolumeTestJSON-server-675334656</nova:name>
Jul 31 12:33:04 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:33:03</nova:creationTime>
Jul 31 12:33:04 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:33:04 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:33:04 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:33:04 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:33:04 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:33:04 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:33:04 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:33:04 user nova-compute[72447]:       <nova:owner>
Jul 31 12:33:04 user nova-compute[72447]:         <nova:user uuid="33486507bb4141d1a1753054199bce56">tempest-AttachVolumeTestJSON-182433734-project-member</nova:user>
Jul 31 12:33:04 user nova-compute[72447]:         <nova:project uuid="6f7c1764cced4b49ad8e55759362a8db">tempest-AttachVolumeTestJSON-182433734</nova:project>
Jul 31 12:33:04 user nova-compute[72447]:       </nova:owner>
Jul 31 12:33:04 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:33:04 user nova-compute[72447]:       <nova:ports>
Jul 31 12:33:04 user nova-compute[72447]:         <nova:port uuid="23148cca-e577-4eaa-ab83-b87a4d7dd713">
Jul 31 12:33:04 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 12:33:04 user nova-compute[72447]:         </nova:port>
Jul 31 12:33:04 user nova-compute[72447]:       </nova:ports>
Jul 31 12:33:04 user nova-compute[72447]:     </nova:instance>
Jul 31 12:33:04 user nova-compute[72447]:   </metadata>
Jul 31 12:33:04 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:33:04 user nova-compute[72447]:     <system>
Jul 31 12:33:04 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:33:04 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:33:04 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:33:04 user nova-compute[72447]:       <entry name="serial">43b9c1c3-280c-4c26-9435-e50d29b3d8d6</entry>
Jul 31 12:33:04 user nova-compute[72447]:       <entry name="uuid">43b9c1c3-280c-4c26-9435-e50d29b3d8d6</entry>
Jul 31 12:33:04 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:33:04 user nova-compute[72447]:     </system>
Jul 31 12:33:04 user nova-compute[72447]:   </sysinfo>
Jul 31 12:33:04 user nova-compute[72447]:   <os>
Jul 31 12:33:04 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:33:04 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:33:04 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:33:04 user nova-compute[72447]:   </os>
Jul 31 12:33:04 user nova-compute[72447]:   <features>
Jul 31 12:33:04 user nova-compute[72447]:     <acpi/>
Jul 31 12:33:04 user nova-compute[72447]:     <apic/>
Jul 31 12:33:04 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:33:04 user nova-compute[72447]:   </features>
Jul 31 12:33:04 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:33:04 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:33:04 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:33:04 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:33:04 user nova-compute[72447]:   </clock>
Jul 31 12:33:04 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:33:04 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:33:04 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:33:04 user nova-compute[72447]:   </cpu>
Jul 31 12:33:04 user nova-compute[72447]:   <devices>
Jul 31 12:33:04 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:33:04 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:33:04 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk"/>
Jul 31 12:33:04 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:33:04 user nova-compute[72447]:     </disk>
Jul 31 12:33:04 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:33:04 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:33:04 user nova-compute[72447]:       <source dev="/dev/sde"/>
Jul 31 12:33:04 user nova-compute[72447]:       <target dev="vdb" bus="virtio"/>
Jul 31 12:33:04 user nova-compute[72447]:       <serial>9bb2e350-4c8b-4d57-9ca5-592d94123795</serial>
Jul 31 12:33:04 user nova-compute[72447]:     </disk>
Jul 31 12:33:04 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:33:04 user nova-compute[72447]:       <mac address="fa:16:3e:0c:31:61"/>
Jul 31 12:33:04 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:33:04 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:33:04 user nova-compute[72447]:       <target dev="tap23148cca-e5"/>
Jul 31 12:33:04 user nova-compute[72447]:     </interface>
Jul 31 12:33:04 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:33:04 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/console.log" append="off"/>
Jul 31 12:33:04 user nova-compute[72447]:     </serial>
Jul 31 12:33:04 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:33:04 user nova-compute[72447]:     <video>
Jul 31 12:33:04 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:33:04 user nova-compute[72447]:     </video>
Jul 31 12:33:04 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:33:04 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:33:04 user nova-compute[72447]:     </rng>
Jul 31 12:33:04 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:33:04 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:33:04 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:33:04 user nova-compute[72447]:     </memballoon>
Jul 31 12:33:04 user nova-compute[72447]:   </devices>
Jul 31 12:33:04 user nova-compute[72447]: </domain>
Jul 31 12:33:04 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:33:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:04 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'trusted_certs' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.153s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-f3f1534b-16c0-4dee-b78c-d53713113a64" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-f3f1534b-16c0-4dee-b78c-d53713113a64" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Cannot resize image /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'migration_context' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:28:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-675334656',display_name='tempest-AttachVolumeTestJSON-server-675334656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-675334656',id=39,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjaiwoFel2Eh2TCakrkW9agvz+yoDwe/zWXpzkLHB0ZWZVJFVho0opNQvvQrNB2zUmhAKykfMwu2NDRbQKV/RDfX39Ice4f0JVuhVt96pRXbOIBk6k5FqAJVOMHKQRawg==',key_name='tempest-keypair-1537936122',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6f7c1764cced4b49ad8e55759362a8db',ramdisk_id='',reservation_id='r-p6axrgt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-182433734',owner_user_name='tempest-AttachVolumeTestJSON-182433734-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:31:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33486507bb4141d1a1753054199bce56',uuid=43b9c1c3-280c-4c26-9435-e50d29b3d8d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converting VIF {"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG os_vif [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23148cca-e5, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23148cca-e5, col_values=(('external_ids', {'iface-id': '23148cca-e577-4eaa-ab83-b87a4d7dd713', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:31:61', 'vm-uuid': '43b9c1c3-280c-4c26-9435-e50d29b3d8d6'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:05 user nova-compute[72447]: INFO os_vif [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5')
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Updating instance_info_cache with network_info: [{"id": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "address": "fa:16:3e:20:3c:9e", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580d2fc9-3b", "ovs_interfaceid": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-f3f1534b-16c0-4dee-b78c-d53713113a64" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:33:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:33:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-cbed67ea-ccc2-4615-af54-cb050429b98a req-0290e745-84f3-4e31-850e-a277bce47ea8 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:33:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cbed67ea-ccc2-4615-af54-cb050429b98a req-0290e745-84f3-4e31-850e-a277bce47ea8 service nova] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cbed67ea-ccc2-4615-af54-cb050429b98a req-0290e745-84f3-4e31-850e-a277bce47ea8 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cbed67ea-ccc2-4615-af54-cb050429b98a req-0290e745-84f3-4e31-850e-a277bce47ea8 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-cbed67ea-ccc2-4615-af54-cb050429b98a req-0290e745-84f3-4e31-850e-a277bce47ea8 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] No waiting events found dispatching network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:33:07 user nova-compute[72447]: WARNING nova.compute.manager [req-cbed67ea-ccc2-4615-af54-cb050429b98a req-0290e745-84f3-4e31-850e-a277bce47ea8 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received unexpected event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 for instance with vm_state stopped and task_state powering-on.
Jul 31 12:33:07 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:33:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:08 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:33:08 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806788.8865104, 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:33:08 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] VM Resumed (Lifecycle Event)
Jul 31 12:33:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:33:08 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance rebooted successfully.
Jul 31 12:33:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5cb1d155-c0ee-4b67-ad3d-22c8fa969368 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:33:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:33:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:33:08 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 31 12:33:08 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690806788.8886602, 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:33:08 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] VM Started (Lifecycle Event)
Jul 31 12:33:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:33:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:33:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-43a63c26-f766-4b29-a0a3-8f0b71df3b99 req-6ce291e3-ba40-48ee-8e0f-2ef03e77b773 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:33:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-43a63c26-f766-4b29-a0a3-8f0b71df3b99 req-6ce291e3-ba40-48ee-8e0f-2ef03e77b773 service nova] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-43a63c26-f766-4b29-a0a3-8f0b71df3b99 req-6ce291e3-ba40-48ee-8e0f-2ef03e77b773 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-43a63c26-f766-4b29-a0a3-8f0b71df3b99 req-6ce291e3-ba40-48ee-8e0f-2ef03e77b773 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:09 user nova-compute[72447]: DEBUG nova.compute.manager [req-43a63c26-f766-4b29-a0a3-8f0b71df3b99 req-6ce291e3-ba40-48ee-8e0f-2ef03e77b773 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] No waiting events found dispatching network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:33:09 user nova-compute[72447]: WARNING nova.compute.manager [req-43a63c26-f766-4b29-a0a3-8f0b71df3b99 req-6ce291e3-ba40-48ee-8e0f-2ef03e77b773 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received unexpected event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 for instance with vm_state active and task_state None.
Jul 31 12:33:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:33:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:10 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806775.79431, 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:33:10 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] VM Stopped (Lifecycle Event)
Jul 31 12:33:10 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3e2d820d-42a0-4dc0-b358-a38141ea1233 None None] [instance: 6f7f73a0-cc11-4e6d-a9c4-0edd67068ca0] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:33:11 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:33:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:11 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:33:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:33:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:33:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7708MB free_disk=24.76865005493164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance f3f1534b-16c0-4dee-b78c-d53713113a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 48e13eb4-f1e9-415d-8167-1ab683d1680e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 8213834b-8f6f-45eb-a1b7-8ad0561ce275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6707cbc8-a675-4248-b324-40630ebff478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance fdcbf76f-3148-43f5-9c10-358ab668096d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:33:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:33:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:33:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:33:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:33:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:16 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:33:16 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:33:18 user nova-compute[72447]: DEBUG nova.compute.manager [req-599aca89-6b6c-4178-8368-7b4825dc8a9c req-53e9790a-6ec4-499c-ad80-3094f8309d05 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Received event network-changed-a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:33:18 user nova-compute[72447]: DEBUG nova.compute.manager [req-599aca89-6b6c-4178-8368-7b4825dc8a9c req-53e9790a-6ec4-499c-ad80-3094f8309d05 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Refreshing instance network info cache due to event network-changed-a880d610-9f14-4c6b-9326-35e1acfadce9. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:33:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-599aca89-6b6c-4178-8368-7b4825dc8a9c req-53e9790a-6ec4-499c-ad80-3094f8309d05 service nova] Acquiring lock "refresh_cache-6707cbc8-a675-4248-b324-40630ebff478" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:33:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-599aca89-6b6c-4178-8368-7b4825dc8a9c req-53e9790a-6ec4-499c-ad80-3094f8309d05 service nova] Acquired lock "refresh_cache-6707cbc8-a675-4248-b324-40630ebff478" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:33:18 user nova-compute[72447]: DEBUG nova.network.neutron [req-599aca89-6b6c-4178-8368-7b4825dc8a9c req-53e9790a-6ec4-499c-ad80-3094f8309d05 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Refreshing network info cache for port a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:33:18 user nova-compute[72447]: DEBUG nova.network.neutron [req-599aca89-6b6c-4178-8368-7b4825dc8a9c req-53e9790a-6ec4-499c-ad80-3094f8309d05 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Updated VIF entry in instance network info cache for port a880d610-9f14-4c6b-9326-35e1acfadce9. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:33:18 user nova-compute[72447]: DEBUG nova.network.neutron [req-599aca89-6b6c-4178-8368-7b4825dc8a9c req-53e9790a-6ec4-499c-ad80-3094f8309d05 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Updating instance_info_cache with network_info: [{"id": "a880d610-9f14-4c6b-9326-35e1acfadce9", "address": "fa:16:3e:cb:dd:96", "network": {"id": "7a6b5ac7-4005-4a8b-9e99-f243de007ed1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1888569421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b255b73bddd844339eb858285c00db00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa880d610-9f", "ovs_interfaceid": "a880d610-9f14-4c6b-9326-35e1acfadce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:33:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-599aca89-6b6c-4178-8368-7b4825dc8a9c req-53e9790a-6ec4-499c-ad80-3094f8309d05 service nova] Releasing lock "refresh_cache-6707cbc8-a675-4248-b324-40630ebff478" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:33:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:19 user nova-compute[72447]: INFO nova.compute.manager [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Detaching volume 74cc0cd0-af58-4854-9881-e9be36c20422
Jul 31 12:33:19 user nova-compute[72447]: INFO nova.virt.block_device [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Attempting to driver detach volume 74cc0cd0-af58-4854-9881-e9be36c20422 from mountpoint /dev/vdb
Jul 31 12:33:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Attempting to detach device vdb from instance 48e13eb4-f1e9-415d-8167-1ab683d1680e from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:33:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:33:19 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:33:19 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:33:19 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:33:19 user nova-compute[72447]:   <serial>74cc0cd0-af58-4854-9881-e9be36c20422</serial>
Jul 31 12:33:19 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:33:19 user nova-compute[72447]: </disk>
Jul 31 12:33:19 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:33:19 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Successfully detached device vdb from instance 48e13eb4-f1e9-415d-8167-1ab683d1680e from the persistent domain config.
Jul 31 12:33:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48e13eb4-f1e9-415d-8167-1ab683d1680e from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:33:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:33:19 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:33:19 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:33:19 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:33:19 user nova-compute[72447]:   <serial>74cc0cd0-af58-4854-9881-e9be36c20422</serial>
Jul 31 12:33:19 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:33:19 user nova-compute[72447]: </disk>
Jul 31 12:33:19 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806800.1581523, 48e13eb4-f1e9-415d-8167-1ab683d1680e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48e13eb4-f1e9-415d-8167-1ab683d1680e {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:33:20 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Successfully detached device vdb from instance 48e13eb4-f1e9-415d-8167-1ab683d1680e from the live domain config.
Jul 31 12:33:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpVbOYXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:33:20 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[421dbe55-b8fc-4036-8768-d8f18bbd1631]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ac26c8-2023-4464-ab30-8e6c0716a90e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:20 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:33:20 user nova-compute[72447]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)
Jul 31 12:33:20 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:20 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:20 user nova-compute[72447]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 (non-flash)
Jul 31 12:33:20 user nova-compute[72447]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)
Jul 31 12:33:20 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:20 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0648790550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5496ec97-21c7-474a-b542-1bf706187542]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8e28d3-9e0e-44b3-9101-b55532ce86ef]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba74ef37-36ff-4413-b465-6c4be6370da7]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc4574c-93e5-4583-839b-29031f2fcd18]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5960fb-8546-42a6-8314-8640f2fc8c51]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebeb042-761d-4f58-a7c8-d268ddb970a3]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422, portal: 172.16.0.220,3260]
Jul 31 12:33:20 user nova-compute[72447]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422, portal: 172.16.0.220,3260] successful.
Jul 31 12:33:20 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74cc0cd0-af58-4854-9881-e9be36c20422 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d126b1-19ba-4d97-b020-4fb5c490392a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] <== disconnect_volume: return (308ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:33:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:33:21 user nova-compute[72447]: DEBUG nova.objects.instance [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lazy-loading 'flavor' on Instance uuid 48e13eb4-f1e9-415d-8167-1ab683d1680e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-79f63d7c-cfb9-44ae-8ab3-04e3a4e0bbbe tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.745s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:22 user nova-compute[72447]: INFO nova.compute.manager [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Detaching volume 0022934b-d5b7-42a1-92fe-389d8bba5804
Jul 31 12:33:22 user nova-compute[72447]: INFO nova.virt.block_device [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Attempting to driver detach volume 0022934b-d5b7-42a1-92fe-389d8bba5804 from mountpoint /dev/vdb
Jul 31 12:33:22 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Attempting to detach device vdb from instance 8213834b-8f6f-45eb-a1b7-8ad0561ce275 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:33:22 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:33:22 user nova-compute[72447]:   <source dev="/dev/sdd"/>
Jul 31 12:33:22 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:33:22 user nova-compute[72447]:   <serial>0022934b-d5b7-42a1-92fe-389d8bba5804</serial>
Jul 31 12:33:22 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:33:22 user nova-compute[72447]: </disk>
Jul 31 12:33:22 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:22 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Successfully detached device vdb from instance 8213834b-8f6f-45eb-a1b7-8ad0561ce275 from the persistent domain config.
Jul 31 12:33:22 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8213834b-8f6f-45eb-a1b7-8ad0561ce275 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:33:22 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:33:22 user nova-compute[72447]:   <source dev="/dev/sdd"/>
Jul 31 12:33:22 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:33:22 user nova-compute[72447]:   <serial>0022934b-d5b7-42a1-92fe-389d8bba5804</serial>
Jul 31 12:33:22 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:33:22 user nova-compute[72447]: </disk>
Jul 31 12:33:22 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806802.8594453, 8213834b-8f6f-45eb-a1b7-8ad0561ce275 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8213834b-8f6f-45eb-a1b7-8ad0561ce275 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:33:22 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Successfully detached device vdb from instance 8213834b-8f6f-45eb-a1b7-8ad0561ce275 from the live domain config.
Jul 31 12:33:22 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SETcWCys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:33:22 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:33:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[764a6a30-7e73-4a4d-b852-6885635d5d23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d24c2f4-9f08-4ac1-a724-c0f86959d373]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:22 user nova-compute[72447]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)
Jul 31 12:33:22 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:22 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:22 user nova-compute[72447]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 (non-flash)
Jul 31 12:33:22 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:22 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06682e4280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804'): ({'sdd'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Removing single pathed devices sdd {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b6217b-d416-4f29-bfbd-ba8ab047c46e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[31861802-b895-4743-b906-0ef54c5fa92d]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Flushing IO for device /dev/sdd {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e2aeda-eec2-4b81-ba13-5ed9d90a1cf0]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:33:22 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aa20ef-2428-4166-a669-87d7b063228b]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] SCSI volumes sdd have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG nova.objects.instance [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'flavor' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aa8215-d2b8-43c6-aa5e-8db0533aa2fb]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f73471-55a3-4a2f-93ad-1a28da137e32]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804, portal: 172.16.0.220,3260]
Jul 31 12:33:23 user nova-compute[72447]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804, portal: 172.16.0.220,3260] successful.
Jul 31 12:33:23 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d24321-035a-4a63-adb8-e6f687251360]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] <== disconnect_volume: return (303ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:23 user nova-compute[72447]: INFO nova.compute.manager [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attaching volume 4e997db5-3359-428c-af6d-c274b5a336b9 to /dev/vdb
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.utils [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a83398d-d32c-411a-aeed-3d608ad6ab5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5687fba8-c987-4c49-8298-233c32a713fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[80be117b-bc1f-4114-8d33-bdb732b7e252]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f9ef9-e954-4e31-aa20-dced7d645057]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:33:23 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5f31b2-5683-492f-937b-890207dfd7d6]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG os_brick.utils [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Updating existing volume attachment record: 60066e69-2b06-4c22-a431-a94b0cb3d20a {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG nova.objects.instance [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lazy-loading 'flavor' on Instance uuid 8213834b-8f6f-45eb-a1b7-8ad0561ce275 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2644174a-0147-438f-a1a7-bcfb9451441c tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.686s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.572s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:23 user nova-compute[72447]: INFO nova.compute.manager [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Terminating instance
Jul 31 12:33:23 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG nova.compute.manager [req-cefd0773-09b0-4148-baab-7ee0bfa2c543 req-b19d1f52-54be-4844-b398-2a7f7f582339 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Received event network-vif-unplugged-77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cefd0773-09b0-4148-baab-7ee0bfa2c543 req-b19d1f52-54be-4844-b398-2a7f7f582339 service nova] Acquiring lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cefd0773-09b0-4148-baab-7ee0bfa2c543 req-b19d1f52-54be-4844-b398-2a7f7f582339 service nova] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cefd0773-09b0-4148-baab-7ee0bfa2c543 req-b19d1f52-54be-4844-b398-2a7f7f582339 service nova] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG nova.compute.manager [req-cefd0773-09b0-4148-baab-7ee0bfa2c543 req-b19d1f52-54be-4844-b398-2a7f7f582339 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] No waiting events found dispatching network-vif-unplugged-77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG nova.compute.manager [req-cefd0773-09b0-4148-baab-7ee0bfa2c543 req-b19d1f52-54be-4844-b398-2a7f7f582339 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Received event network-vif-unplugged-77c8b570-0995-4ad9-b741-5d4a8bdb8920 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:33:24 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Instance destroyed successfully.
Jul 31 12:33:24 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lazy-loading 'resources' on Instance uuid 8213834b-8f6f-45eb-a1b7-8ad0561ce275 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:31:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1145354721',display_name='tempest-VolumesSnapshotTestJSON-instance-1145354721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1145354721',id=41,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTVxYXvV38GMK176OYxKqxYxP7nqKJsXoWc0YsXOq8g4GJdUMhNs0KnpreSpAV333n/0w5vyLzUvRAXWYsV7/ys4ZtBsr0bqUPmlYzctdVZ11GOddlJDQ0FMjjDOkg1Ig==',key_name='tempest-keypair-2121850395',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:31:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c46c90a8c1f42aeb9e63db6aa240ab5',ramdisk_id='',reservation_id='r-5klmjgxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1298774726',owner_user_name='tempest-VolumesSnapshotTestJSON-1298774726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:31:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9517e4295d8c4e22a09e193f9687811c',uuid=8213834b-8f6f-45eb-a1b7-8ad0561ce275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "address": "fa:16:3e:63:eb:94", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c8b570-09", "ovs_interfaceid": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Converting VIF {"id": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "address": "fa:16:3e:63:eb:94", "network": {"id": "c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1278727164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c46c90a8c1f42aeb9e63db6aa240ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c8b570-09", "ovs_interfaceid": "77c8b570-0995-4ad9-b741-5d4a8bdb8920", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:eb:94,bridge_name='br-int',has_traffic_filtering=True,id=77c8b570-0995-4ad9-b741-5d4a8bdb8920,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c8b570-09') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG os_vif [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:eb:94,bridge_name='br-int',has_traffic_filtering=True,id=77c8b570-0995-4ad9-b741-5d4a8bdb8920,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c8b570-09') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77c8b570-09, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:33:24 user nova-compute[72447]: INFO os_vif [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:eb:94,bridge_name='br-int',has_traffic_filtering=True,id=77c8b570-0995-4ad9-b741-5d4a8bdb8920,network=Network(c04ce261-03a9-497e-bb1c-fcbf7f5d1dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c8b570-09')
Jul 31 12:33:24 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SETcWCys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:33:24 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:33:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0022934b-d5b7-42a1-92fe-389d8bba5804', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab51902-4efc-4073-9aa5-5d1b5a5d483a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[da484328-0f34-4ceb-a1ea-7980a9f9499a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:24 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:24 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:24 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:24 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06487837f0>, {}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Disconnecting from: [] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] <== disconnect_volume: return (50ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:33:24 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Deleting instance files /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275_del
Jul 31 12:33:24 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Deletion of /opt/stack/data/nova/instances/8213834b-8f6f-45eb-a1b7-8ad0561ce275_del complete
Jul 31 12:33:24 user nova-compute[72447]: INFO nova.compute.manager [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 31 12:33:24 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:33:24 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:33:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:25 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:33:25 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Took 0.87 seconds to deallocate network for instance.
Jul 31 12:33:25 user nova-compute[72447]: WARNING nova.volume.cinder [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Attachment 02bec419-8db1-4f36-a646-4f66d0c54f1e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 02bec419-8db1-4f36-a646-4f66d0c54f1e. (HTTP 404) (Request-ID: req-8f3bf547-9ae9-4f92-8ed5-b8ab8b3b26b7)
Jul 31 12:33:25 user nova-compute[72447]: INFO nova.compute.manager [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Took 0.02 seconds to detach 1 volumes for instance.
Jul 31 12:33:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:26 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:33:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:33:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:26 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Deleted allocations for instance 8213834b-8f6f-45eb-a1b7-8ad0561ce275
Jul 31 12:33:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3ccf180a-e8e7-489f-9b84-a9a393e82800 tempest-VolumesSnapshotTestJSON-1298774726 tempest-VolumesSnapshotTestJSON-1298774726-project-member] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.305s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-b052565b-953b-4870-9269-05aee26ee1fb req-d45ebbf9-b809-4a58-b14d-b629b1bd58e5 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Received event network-vif-plugged-77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:33:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b052565b-953b-4870-9269-05aee26ee1fb req-d45ebbf9-b809-4a58-b14d-b629b1bd58e5 service nova] Acquiring lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b052565b-953b-4870-9269-05aee26ee1fb req-d45ebbf9-b809-4a58-b14d-b629b1bd58e5 service nova] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b052565b-953b-4870-9269-05aee26ee1fb req-d45ebbf9-b809-4a58-b14d-b629b1bd58e5 service nova] Lock "8213834b-8f6f-45eb-a1b7-8ad0561ce275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-b052565b-953b-4870-9269-05aee26ee1fb req-d45ebbf9-b809-4a58-b14d-b629b1bd58e5 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] No waiting events found dispatching network-vif-plugged-77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:33:26 user nova-compute[72447]: WARNING nova.compute.manager [req-b052565b-953b-4870-9269-05aee26ee1fb req-d45ebbf9-b809-4a58-b14d-b629b1bd58e5 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Received unexpected event network-vif-plugged-77c8b570-0995-4ad9-b741-5d4a8bdb8920 for instance with vm_state deleted and task_state None.
Jul 31 12:33:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-b052565b-953b-4870-9269-05aee26ee1fb req-d45ebbf9-b809-4a58-b14d-b629b1bd58e5 service nova] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Received event network-vif-deleted-77c8b570-0995-4ad9-b741-5d4a8bdb8920 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:33:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jENUAOZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:33:30 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:33:30 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:33:30 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[069a902c-fe6b-4902-b13d-91b1e17a6a02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:33:30 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d299cd-a91e-48f1-83ff-037b8aeb4b11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9] added
Jul 31 12:33:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7f3cff-74ed-4ab7-a62d-4b87decd3e2e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e896ee-883e-4775-affa-978b75d34087]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jENUAOZP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jENUAOZP" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4733d8a5-9106-4c3b-8088-742cc66b91f5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jENUAOZP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d1f700-1cea-4c71-b60c-f7aa0e840f7b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7157239b-bc7b-4d45-a51b-3b900d993883]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:30 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:30 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c61afa-4e1c-4fce-9ed2-6e843914d8ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9, portal: 172.16.0.220,3260]
Jul 31 12:33:30 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9, portal: 172.16.0.220,3260] successful.
Jul 31 12:33:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2625b7eb-2da1-49d2-b865-9aa4241b9194]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17f57b3-2761-4c11-b3b0-1c9cd23595e3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:31 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:31 user nova-compute[72447]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 (non-flash)
Jul 31 12:33:31 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:31 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:31 user nova-compute[72447]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 (non-flash)
Jul 31 12:33:31 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.162s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[371f7124-1756-4a2f-8e7b-6939126ac705]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:33:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jENUAOZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:33:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:33:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '23335346638633437', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:33:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335346638633437', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:33:32 user nova-compute[72447]: DEBUG nova.objects.instance [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'flavor' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:33:32 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:33:32 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:33:32 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:33:32 user nova-compute[72447]:   <serial>4e997db5-3359-428c-af6d-c274b5a336b9</serial>
Jul 31 12:33:32 user nova-compute[72447]: </disk>
Jul 31 12:33:32 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:33:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:33:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:33:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No VIF found with MAC fa:16:3e:cb:dd:96, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:33:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-888c07bb-1923-4fd9-8b69-279be46de017 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.612s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:39 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806804.7587328, 8213834b-8f6f-45eb-a1b7-8ad0561ce275 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:33:39 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] VM Stopped (Lifecycle Event)
Jul 31 12:33:39 user nova-compute[72447]: DEBUG nova.compute.manager [None req-32901dcb-a818-4a30-a2b8-194effbb346d None None] [instance: 8213834b-8f6f-45eb-a1b7-8ad0561ce275] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:33:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "f3f1534b-16c0-4dee-b78c-d53713113a64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:45 user nova-compute[72447]: INFO nova.compute.manager [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Terminating instance
Jul 31 12:33:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-69977f8e-7959-431e-aba2-ff77453b832f req-88457d5b-0e34-448c-abd4-2dab78d75fa1 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Received event network-changed-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-69977f8e-7959-431e-aba2-ff77453b832f req-88457d5b-0e34-448c-abd4-2dab78d75fa1 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Refreshing instance network info cache due to event network-changed-148f60a6-1d5e-4b9b-9f8c-f199bb48f252. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-69977f8e-7959-431e-aba2-ff77453b832f req-88457d5b-0e34-448c-abd4-2dab78d75fa1 service nova] Acquiring lock "refresh_cache-fdcbf76f-3148-43f5-9c10-358ab668096d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-69977f8e-7959-431e-aba2-ff77453b832f req-88457d5b-0e34-448c-abd4-2dab78d75fa1 service nova] Acquired lock "refresh_cache-fdcbf76f-3148-43f5-9c10-358ab668096d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG nova.network.neutron [req-69977f8e-7959-431e-aba2-ff77453b832f req-88457d5b-0e34-448c-abd4-2dab78d75fa1 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Refreshing network info cache for port 148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "fdcbf76f-3148-43f5-9c10-358ab668096d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lazy-loading 'flavor' on Instance uuid fdcbf76f-3148-43f5-9c10-358ab668096d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG nova.network.neutron [req-69977f8e-7959-431e-aba2-ff77453b832f req-88457d5b-0e34-448c-abd4-2dab78d75fa1 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Updated VIF entry in instance network info cache for port 148f60a6-1d5e-4b9b-9f8c-f199bb48f252. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG nova.network.neutron [req-69977f8e-7959-431e-aba2-ff77453b832f req-88457d5b-0e34-448c-abd4-2dab78d75fa1 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Updating instance_info_cache with network_info: [{"id": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "address": "fa:16:3e:b5:b6:a8", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148f60a6-1d", "ovs_interfaceid": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-69977f8e-7959-431e-aba2-ff77453b832f req-88457d5b-0e34-448c-abd4-2dab78d75fa1 service nova] Releasing lock "refresh_cache-fdcbf76f-3148-43f5-9c10-358ab668096d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "fdcbf76f-3148-43f5-9c10-358ab668096d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:46 user nova-compute[72447]: INFO nova.compute.manager [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Attaching volume 0189ddb0-ad67-46e0-86de-cd947e4e7919 to /dev/vdb
Jul 31 12:33:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Instance destroyed successfully.
Jul 31 12:33:46 user nova-compute[72447]: DEBUG os_brick.utils [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'resources' on Instance uuid f3f1534b-16c0-4dee-b78c-d53713113a64 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-377701257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-377701257',id=31,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-sbtabmz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:26:17Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=f3f1534b-16c0-4dee-b78c-d53713113a64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "address": "fa:16:3e:20:3c:9e", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580d2fc9-3b", "ovs_interfaceid": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "address": "fa:16:3e:20:3c:9e", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580d2fc9-3b", "ovs_interfaceid": "580d2fc9-3bdb-40d4-9630-c211b3e3cd3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=580d2fc9-3bdb-40d4-9630-c211b3e3cd3e,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580d2fc9-3b') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG os_vif [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=580d2fc9-3bdb-40d4-9630-c211b3e3cd3e,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580d2fc9-3b') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f21ab6f-5e6a-4155-b182-29d9c012908c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap580d2fc9-3b, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:33:46 user nova-compute[72447]: INFO os_vif [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=580d2fc9-3bdb-40d4-9630-c211b3e3cd3e,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580d2fc9-3b')
Jul 31 12:33:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Deleting instance files /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64_del
Jul 31 12:33:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Deletion of /opt/stack/data/nova/instances/f3f1534b-16c0-4dee-b78c-d53713113a64_del complete
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2179988f-b888-47dd-b25b-3abcfebab986]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78a22de-ac4b-4ae9-9000-b9194f3d7d2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e52c818-4cfe-4fdd-af41-9e24eca61806]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:46 user nova-compute[72447]: INFO nova.compute.manager [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Took 0.97 seconds to destroy the instance on the hypervisor.
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:33:46 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:33:46 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[549cdc75-8616-40a1-a8a0-42e09142f8d6]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG os_brick.utils [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:33:46 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Updating existing volume attachment record: 59a9b878-0787-4c33-b24c-1cb7e7e230bc {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:33:47 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Took 0.76 seconds to deallocate network for instance.
Jul 31 12:33:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-ad23894c-6134-4964-8473-3479ddc3a911 req-c45e018d-5e28-4cbf-81e2-59a545503116 service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Received event network-vif-deleted-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-4dacbcfd-947c-4992-970b-a1d4261dd900 req-2a0d185f-428d-42fd-bc44-434539762bfb service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Received event network-vif-unplugged-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4dacbcfd-947c-4992-970b-a1d4261dd900 req-2a0d185f-428d-42fd-bc44-434539762bfb service nova] Acquiring lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4dacbcfd-947c-4992-970b-a1d4261dd900 req-2a0d185f-428d-42fd-bc44-434539762bfb service nova] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4dacbcfd-947c-4992-970b-a1d4261dd900 req-2a0d185f-428d-42fd-bc44-434539762bfb service nova] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-4dacbcfd-947c-4992-970b-a1d4261dd900 req-2a0d185f-428d-42fd-bc44-434539762bfb service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] No waiting events found dispatching network-vif-unplugged-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:33:47 user nova-compute[72447]: WARNING nova.compute.manager [req-4dacbcfd-947c-4992-970b-a1d4261dd900 req-2a0d185f-428d-42fd-bc44-434539762bfb service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Received unexpected event network-vif-unplugged-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e for instance with vm_state deleted and task_state None.
Jul 31 12:33:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-4dacbcfd-947c-4992-970b-a1d4261dd900 req-2a0d185f-428d-42fd-bc44-434539762bfb service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Received event network-vif-plugged-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4dacbcfd-947c-4992-970b-a1d4261dd900 req-2a0d185f-428d-42fd-bc44-434539762bfb service nova] Acquiring lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4dacbcfd-947c-4992-970b-a1d4261dd900 req-2a0d185f-428d-42fd-bc44-434539762bfb service nova] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4dacbcfd-947c-4992-970b-a1d4261dd900 req-2a0d185f-428d-42fd-bc44-434539762bfb service nova] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-4dacbcfd-947c-4992-970b-a1d4261dd900 req-2a0d185f-428d-42fd-bc44-434539762bfb service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] No waiting events found dispatching network-vif-plugged-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:33:47 user nova-compute[72447]: WARNING nova.compute.manager [req-4dacbcfd-947c-4992-970b-a1d4261dd900 req-2a0d185f-428d-42fd-bc44-434539762bfb service nova] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Received unexpected event network-vif-plugged-580d2fc9-3bdb-40d4-9630-c211b3e3cd3e for instance with vm_state deleted and task_state None.
Jul 31 12:33:47 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:33:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:47 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Deleted allocations for instance f3f1534b-16c0-4dee-b78c-d53713113a64
Jul 31 12:33:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-9311c0eb-0cd5-4906-9654-771227789305 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "f3f1534b-16c0-4dee-b78c-d53713113a64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.285s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:33:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:33:49 user nova-compute[72447]: INFO nova.compute.manager [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Detaching volume 4e997db5-3359-428c-af6d-c274b5a336b9
Jul 31 12:33:49 user nova-compute[72447]: INFO nova.virt.block_device [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attempting to driver detach volume 4e997db5-3359-428c-af6d-c274b5a336b9 from mountpoint /dev/vdb
Jul 31 12:33:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Attempting to detach device vdb from instance 6707cbc8-a675-4248-b324-40630ebff478 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:33:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:33:49 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:33:49 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:33:49 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:33:49 user nova-compute[72447]:   <serial>4e997db5-3359-428c-af6d-c274b5a336b9</serial>
Jul 31 12:33:49 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:33:49 user nova-compute[72447]: </disk>
Jul 31 12:33:49 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:33:49 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Successfully detached device vdb from instance 6707cbc8-a675-4248-b324-40630ebff478 from the persistent domain config.
Jul 31 12:33:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6707cbc8-a675-4248-b324-40630ebff478 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:33:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:33:49 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:33:49 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:33:49 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:33:49 user nova-compute[72447]:   <serial>4e997db5-3359-428c-af6d-c274b5a336b9</serial>
Jul 31 12:33:49 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:33:49 user nova-compute[72447]: </disk>
Jul 31 12:33:49 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806830.2380333, 6707cbc8-a675-4248-b324-40630ebff478 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:33:50 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Successfully detached device vdb from instance 6707cbc8-a675-4248-b324-40630ebff478 from the live domain config.
Jul 31 12:33:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jENUAOZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:33:50 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35dbbb5-1b13-4cf2-9e76-11a5344f4f25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf90466c-4202-431c-b088-b91c13cf3bfd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:50 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:50 user nova-compute[72447]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 (non-flash)
Jul 31 12:33:50 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:33:50 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:33:50 user nova-compute[72447]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 (non-flash)
Jul 31 12:33:50 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06486411b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a142575-811e-45e6-8d76-1d8edfb90c2a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9010c370-62f6-4d8e-a011-74172fe4c9a8]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de8e0d8-5879-489e-8bfb-dd02b14227c1]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca87539e-5518-474e-a201-59edc9e47561]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[75387f40-418f-4ddd-a77e-cd0e1dc3e078]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[420e0904-cea6-42dd-98f8-6d4ce9d2ad9e]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9, portal: 172.16.0.220,3260]
Jul 31 12:33:50 user nova-compute[72447]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9, portal: 172.16.0.220,3260] successful.
Jul 31 12:33:50 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb85173-b335-4965-8c58-591780aa8f20]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] <== disconnect_volume: return (269ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:33:50 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:33:51 user nova-compute[72447]: DEBUG nova.objects.instance [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'flavor' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:33:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-21fbca6d-4503-4fcc-9729-a02f77e628be tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.839s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.volume.cinder [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Update attachment failed for attachment 59a9b878-0787-4c33-b24c-1cb7e7e230bc. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:0189ddb0-ad67-46e0-86de-cd947e4e7919 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:0189ddb0-ad67-46e0-86de-cd947e4e7919/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 was not found.).). (HTTP 500) (Request-ID: req-52421eb1-7789-49ed-9a47-e1d1efca4bbf) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:0189ddb0-ad67-46e0-86de-cd947e4e7919 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:0189ddb0-ad67-46e0-86de-cd947e4e7919/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 was not found.).). (HTTP 500) (Request-ID: req-52421eb1-7789-49ed-9a47-e1d1efca4bbf)
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Failed to attach 0189ddb0-ad67-46e0-86de-cd947e4e7919 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:0189ddb0-ad67-46e0-86de-cd947e4e7919 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:0189ddb0-ad67-46e0-86de-cd947e4e7919/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 was not found.).). (HTTP 500) (Request-ID: req-52421eb1-7789-49ed-9a47-e1d1efca4bbf)
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Traceback (most recent call last):
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     bdm.attach(context, instance, self.volume_api, self.driver,
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     ret_val = method(obj, context, *args, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     self._do_attach(context, instance, volume, volume_api,
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     self._volume_attach(context, volume, connector, instance,
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     connection_info = volume_api.attachment_update(
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     res = method(self, ctx, *args, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     with excutils.save_and_reraise_exception():
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     self.force_reraise()
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     raise self.value
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     context, '3.44', skip_version_check=True).attachments.update(
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     return method.func(obj, *args, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     resp = self._update('/attachments/%s' % id, body)
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     return self._cs_request(url, 'PUT', **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     return self.request(url, method, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d]     raise exceptions.from_response(resp, body)
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:0189ddb0-ad67-46e0-86de-cd947e4e7919 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:0189ddb0-ad67-46e0-86de-cd947e4e7919/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 was not found.).). (HTTP 500) (Request-ID: req-52421eb1-7789-49ed-9a47-e1d1efca4bbf)
Jul 31 12:33:51 user nova-compute[72447]: ERROR nova.compute.manager [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] 
Jul 31 12:33:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.345s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server [None req-def5c134-6771-450d-8c96-8e16d78d1386 tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:0189ddb0-ad67-46e0-86de-cd947e4e7919 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:0189ddb0-ad67-46e0-86de-cd947e4e7919/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 was not found.).). (HTTP 500) (Request-ID: req-52421eb1-7789-49ed-9a47-e1d1efca4bbf)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py", line 414, in inner
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:0189ddb0-ad67-46e0-86de-cd947e4e7919 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:0189ddb0-ad67-46e0-86de-cd947e4e7919/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4e997db5-3359-428c-af6d-c274b5a336b9 was not found.).). (HTTP 500) (Request-ID: req-52421eb1-7789-49ed-9a47-e1d1efca4bbf)
Jul 31 12:33:51 user nova-compute[72447]: ERROR oslo_messaging.rpc.server 
Jul 31 12:33:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:33:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:01 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806826.6401174, f3f1534b-16c0-4dee-b78c-d53713113a64 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:34:01 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] VM Stopped (Lifecycle Event)
Jul 31 12:34:01 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fcef403f-85f2-4482-80e2-54db06ee820d None None] [instance: f3f1534b-16c0-4dee-b78c-d53713113a64] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:34:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:05 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:34:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:34:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:34:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:34:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:34:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Updating instance_info_cache with network_info: [{"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:34:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:34:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:34:06 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:34:06 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:34:06 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:34:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:34:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:09 user nova-compute[72447]: INFO nova.compute.manager [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Terminating instance
Jul 31 12:34:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b4e354dc-c949-4f51-b673-2f931178b305 req-ed9fcb5f-9547-4348-b2df-234f84de762f service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Received event network-vif-unplugged-5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b4e354dc-c949-4f51-b673-2f931178b305 req-ed9fcb5f-9547-4348-b2df-234f84de762f service nova] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b4e354dc-c949-4f51-b673-2f931178b305 req-ed9fcb5f-9547-4348-b2df-234f84de762f service nova] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b4e354dc-c949-4f51-b673-2f931178b305 req-ed9fcb5f-9547-4348-b2df-234f84de762f service nova] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b4e354dc-c949-4f51-b673-2f931178b305 req-ed9fcb5f-9547-4348-b2df-234f84de762f service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] No waiting events found dispatching network-vif-unplugged-5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-b4e354dc-c949-4f51-b673-2f931178b305 req-ed9fcb5f-9547-4348-b2df-234f84de762f service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Received event network-vif-unplugged-5b8d4302-80bf-4360-bb21-2e287c5732dd for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:10 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Instance destroyed successfully.
Jul 31 12:34:10 user nova-compute[72447]: DEBUG nova.objects.instance [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lazy-loading 'resources' on Instance uuid 48e13eb4-f1e9-415d-8167-1ab683d1680e {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-275536995',display_name='tempest-TestServerVolumeAttachmentScenario-server-275536995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-275536995',id=40,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERdFp3IwQsn0gm2XPX9RAumGxoj9l8onrUabTv2bpWWcBE69DeTMoqorGduCX3oCDm/LozqXYCji2oyAavMRnAKWnnX510wT6CT0dOFlPBpUDrVnEbSws55un7qnDoXrg==',key_name='tempest-keypair-314356135',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:30:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33c6b4b34cf749a488dc865c1662a22e',ramdisk_id='',reservation_id='r-wmu8gnu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1068509389',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1068509389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc3c158bb86b454b8527d84833be1543',uuid=48e13eb4-f1e9-415d-8167-1ab683d1680e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "address": "fa:16:3e:63:69:0e", "network": {"id": "f7ca946a-7d88-4acb-ba32-111edd4250db", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264876345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33c6b4b34cf749a488dc865c1662a22e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8d4302-80", "ovs_interfaceid": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Converting VIF {"id": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "address": "fa:16:3e:63:69:0e", "network": {"id": "f7ca946a-7d88-4acb-ba32-111edd4250db", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1264876345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33c6b4b34cf749a488dc865c1662a22e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8d4302-80", "ovs_interfaceid": "5b8d4302-80bf-4360-bb21-2e287c5732dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:69:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b8d4302-80bf-4360-bb21-2e287c5732dd,network=Network(f7ca946a-7d88-4acb-ba32-111edd4250db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8d4302-80') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG os_vif [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:69:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b8d4302-80bf-4360-bb21-2e287c5732dd,network=Network(f7ca946a-7d88-4acb-ba32-111edd4250db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8d4302-80') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b8d4302-80, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:34:10 user nova-compute[72447]: INFO os_vif [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:69:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b8d4302-80bf-4360-bb21-2e287c5732dd,network=Network(f7ca946a-7d88-4acb-ba32-111edd4250db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8d4302-80')
Jul 31 12:34:10 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Deleting instance files /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e_del
Jul 31 12:34:10 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Deletion of /opt/stack/data/nova/instances/48e13eb4-f1e9-415d-8167-1ab683d1680e_del complete
Jul 31 12:34:10 user nova-compute[72447]: INFO nova.compute.manager [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 31 12:34:10 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:34:10 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:34:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:11 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:34:11 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Took 0.94 seconds to deallocate network for instance.
Jul 31 12:34:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-6383b333-3e73-4d42-b596-0a9aae9744e2 req-b1a75fbd-ae9e-4216-8e7a-ece4e3402817 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Received event network-vif-deleted-5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:34:11 user nova-compute[72447]: INFO nova.compute.manager [req-6383b333-3e73-4d42-b596-0a9aae9744e2 req-b1a75fbd-ae9e-4216-8e7a-ece4e3402817 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Neutron deleted interface 5b8d4302-80bf-4360-bb21-2e287c5732dd; detaching it from the instance and deleting it from the info cache
Jul 31 12:34:11 user nova-compute[72447]: DEBUG nova.network.neutron [req-6383b333-3e73-4d42-b596-0a9aae9744e2 req-b1a75fbd-ae9e-4216-8e7a-ece4e3402817 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:34:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-6383b333-3e73-4d42-b596-0a9aae9744e2 req-b1a75fbd-ae9e-4216-8e7a-ece4e3402817 service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Detach interface failed, port_id=5b8d4302-80bf-4360-bb21-2e287c5732dd, reason: Instance 48e13eb4-f1e9-415d-8167-1ab683d1680e could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:34:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:12 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Deleted allocations for instance 48e13eb4-f1e9-415d-8167-1ab683d1680e
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc52da9d-d037-4849-8b29-4af675051043 tempest-TestServerVolumeAttachmentScenario-1068509389 tempest-TestServerVolumeAttachmentScenario-1068509389-project-member] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.253s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-fb191b14-8382-4ecb-b289-0f9f45bc670f req-fe569cff-aa28-4b0e-bcc4-69b6d0e9056a service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Received event network-vif-plugged-5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fb191b14-8382-4ecb-b289-0f9f45bc670f req-fe569cff-aa28-4b0e-bcc4-69b6d0e9056a service nova] Acquiring lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fb191b14-8382-4ecb-b289-0f9f45bc670f req-fe569cff-aa28-4b0e-bcc4-69b6d0e9056a service nova] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fb191b14-8382-4ecb-b289-0f9f45bc670f req-fe569cff-aa28-4b0e-bcc4-69b6d0e9056a service nova] Lock "48e13eb4-f1e9-415d-8167-1ab683d1680e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-fb191b14-8382-4ecb-b289-0f9f45bc670f req-fe569cff-aa28-4b0e-bcc4-69b6d0e9056a service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] No waiting events found dispatching network-vif-plugged-5b8d4302-80bf-4360-bb21-2e287c5732dd {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:34:12 user nova-compute[72447]: WARNING nova.compute.manager [req-fb191b14-8382-4ecb-b289-0f9f45bc670f req-fe569cff-aa28-4b0e-bcc4-69b6d0e9056a service nova] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Received unexpected event network-vif-plugged-5b8d4302-80bf-4360-bb21-2e287c5732dd for instance with vm_state deleted and task_state None.
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:34:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:34:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:34:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:34:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=7988MB free_disk=24.92992401123047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 0dbd2353-0521-4e92-8722-6151bfb40924 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6707cbc8-a675-4248-b324-40630ebff478 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance fdcbf76f-3148-43f5-9c10-358ab668096d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:34:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:34:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:34:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:25 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806850.750602, 48e13eb4-f1e9-415d-8167-1ab683d1680e => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:34:25 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] VM Stopped (Lifecycle Event)
Jul 31 12:34:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-5032c056-26ef-459a-af5e-28713ac386c2 None None] [instance: 48e13eb4-f1e9-415d-8167-1ab683d1680e] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:34:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:34:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:34:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:34:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:34:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:34:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:34:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:34:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:34:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:34:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "0dbd2353-0521-4e92-8722-6151bfb40924" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:36 user nova-compute[72447]: INFO nova.compute.manager [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Terminating instance
Jul 31 12:34:36 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-65fe6571-cd25-442d-b2cb-3c377f20309e req-92d269c4-d1de-4011-bffa-898260f0fcdc service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-unplugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-65fe6571-cd25-442d-b2cb-3c377f20309e req-92d269c4-d1de-4011-bffa-898260f0fcdc service nova] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-65fe6571-cd25-442d-b2cb-3c377f20309e req-92d269c4-d1de-4011-bffa-898260f0fcdc service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-65fe6571-cd25-442d-b2cb-3c377f20309e req-92d269c4-d1de-4011-bffa-898260f0fcdc service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-65fe6571-cd25-442d-b2cb-3c377f20309e req-92d269c4-d1de-4011-bffa-898260f0fcdc service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] No waiting events found dispatching network-vif-unplugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-65fe6571-cd25-442d-b2cb-3c377f20309e req-92d269c4-d1de-4011-bffa-898260f0fcdc service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-unplugged-7e1213ee-4076-42af-a8cb-d3825739d314 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:34:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:37 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Instance destroyed successfully.
Jul 31 12:34:37 user nova-compute[72447]: DEBUG nova.objects.instance [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'resources' on Instance uuid 0dbd2353-0521-4e92-8722-6151bfb40924 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-444683405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-444683405',id=23,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:20:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-io8hutry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:22:34Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=0dbd2353-0521-4e92-8722-6151bfb40924,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "7e1213ee-4076-42af-a8cb-d3825739d314", "address": "fa:16:3e:81:a7:b9", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1213ee-40", "ovs_interfaceid": "7e1213ee-4076-42af-a8cb-d3825739d314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:a7:b9,bridge_name='br-int',has_traffic_filtering=True,id=7e1213ee-4076-42af-a8cb-d3825739d314,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1213ee-40') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_vif [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:a7:b9,bridge_name='br-int',has_traffic_filtering=True,id=7e1213ee-4076-42af-a8cb-d3825739d314,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1213ee-40') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e1213ee-40, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:34:37 user nova-compute[72447]: INFO os_vif [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:a7:b9,bridge_name='br-int',has_traffic_filtering=True,id=7e1213ee-4076-42af-a8cb-d3825739d314,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1213ee-40')
Jul 31 12:34:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbGehHtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:34:37 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af52a06-c1bc-4019-af62-264a02094d6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[520a75d7-8f1a-43ff-841f-75bb11a3293c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:34:37 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:34:37 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 (non-flash)
Jul 31 12:34:37 user nova-compute[72447]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:34:37 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f064867b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466'): ({'sdc'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Removing single pathed devices sdc {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[830d8a97-412a-4e3a-af3c-c902b811a7ec]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e34e56-27e1-40ce-afc6-12bc64fc9ca7]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Flushing IO for device /dev/sdc {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e2eae7-365a-405f-a9be-c141cff86cc5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bdabf2-23c1-4db7-9e97-8c524eafc710]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3454988-25a7-4ae8-814b-8ab2de671883]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0907a240-0990-4a10-b40a-d7fc6baec178]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466, portal: 172.16.0.220,3260]
Jul 31 12:34:37 user nova-compute[72447]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466, portal: 172.16.0.220,3260] successful.
Jul 31 12:34:37 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c390fca-f26f-4a6f-8340-a3037945e466 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[138b026d-a0a3-4bb5-bb9f-19f23705cf51]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] <== disconnect_volume: return (298ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:34:37 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Deleting instance files /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924_del
Jul 31 12:34:37 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Deletion of /opt/stack/data/nova/instances/0dbd2353-0521-4e92-8722-6151bfb40924_del complete
Jul 31 12:34:37 user nova-compute[72447]: INFO nova.compute.manager [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 31 12:34:37 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:34:37 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:34:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-d5bf639e-8f61-4a8a-98eb-57b9fecb90f7 req-41f5a93c-bf6d-411f-bb2d-db61a789a3a6 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:34:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d5bf639e-8f61-4a8a-98eb-57b9fecb90f7 req-41f5a93c-bf6d-411f-bb2d-db61a789a3a6 service nova] Acquiring lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d5bf639e-8f61-4a8a-98eb-57b9fecb90f7 req-41f5a93c-bf6d-411f-bb2d-db61a789a3a6 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d5bf639e-8f61-4a8a-98eb-57b9fecb90f7 req-41f5a93c-bf6d-411f-bb2d-db61a789a3a6 service nova] Lock "0dbd2353-0521-4e92-8722-6151bfb40924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-d5bf639e-8f61-4a8a-98eb-57b9fecb90f7 req-41f5a93c-bf6d-411f-bb2d-db61a789a3a6 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] No waiting events found dispatching network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:34:38 user nova-compute[72447]: WARNING nova.compute.manager [req-d5bf639e-8f61-4a8a-98eb-57b9fecb90f7 req-41f5a93c-bf6d-411f-bb2d-db61a789a3a6 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received unexpected event network-vif-plugged-7e1213ee-4076-42af-a8cb-d3825739d314 for instance with vm_state active and task_state deleting.
Jul 31 12:34:39 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:34:39 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Took 1.42 seconds to deallocate network for instance.
Jul 31 12:34:39 user nova-compute[72447]: DEBUG nova.compute.manager [req-c1793adf-2533-48f4-b68c-5bf0d85b6e3c req-a72575e4-9a03-4e6d-b559-d8782b279a30 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Received event network-vif-deleted-7e1213ee-4076-42af-a8cb-d3825739d314 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:34:39 user nova-compute[72447]: INFO nova.compute.manager [req-c1793adf-2533-48f4-b68c-5bf0d85b6e3c req-a72575e4-9a03-4e6d-b559-d8782b279a30 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Neutron deleted interface 7e1213ee-4076-42af-a8cb-d3825739d314; detaching it from the instance and deleting it from the info cache
Jul 31 12:34:39 user nova-compute[72447]: DEBUG nova.network.neutron [req-c1793adf-2533-48f4-b68c-5bf0d85b6e3c req-a72575e4-9a03-4e6d-b559-d8782b279a30 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:34:39 user nova-compute[72447]: DEBUG nova.compute.manager [req-c1793adf-2533-48f4-b68c-5bf0d85b6e3c req-a72575e4-9a03-4e6d-b559-d8782b279a30 service nova] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Detach interface failed, port_id=7e1213ee-4076-42af-a8cb-d3825739d314, reason: Instance 0dbd2353-0521-4e92-8722-6151bfb40924 could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:34:39 user nova-compute[72447]: INFO nova.compute.manager [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Took 0.80 seconds to detach 1 volumes for instance.
Jul 31 12:34:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:40 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:34:40 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:34:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:40 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Deleted allocations for instance 0dbd2353-0521-4e92-8722-6151bfb40924
Jul 31 12:34:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b12407a-2ef9-454b-9d2d-430a4dd72465 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "0dbd2353-0521-4e92-8722-6151bfb40924" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.849s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'flavor' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:34:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:47 user nova-compute[72447]: INFO nova.compute.manager [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attaching volume e8797347-1740-493b-b3a3-99a66973c678 to /dev/vdb
Jul 31 12:34:47 user nova-compute[72447]: DEBUG os_brick.utils [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6746285-4484-48f4-8300-a2a20404a754]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[675c3600-96b8-449f-80fb-11d92ac27eaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f609cdb-649a-4e95-9f25-3d4b7c12b819]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a6687b-6f53-414f-b1aa-c8f902ab75d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:34:47 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:34:47 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2faae15-e689-4874-afd4-3a83f6c60ccd]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG os_brick.utils [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:34:47 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Updating existing volume attachment record: d660ae52-41a5-4436-8568-08689d956f22 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:34:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:51 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:51 user nova-compute[72447]: INFO nova.compute.manager [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Detaching volume 9bb2e350-4c8b-4d57-9ca5-592d94123795
Jul 31 12:34:51 user nova-compute[72447]: INFO nova.virt.block_device [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Attempting to driver detach volume 9bb2e350-4c8b-4d57-9ca5-592d94123795 from mountpoint /dev/vdb
Jul 31 12:34:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Attempting to detach device vdb from instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:34:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:34:51 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:34:51 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:34:51 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:34:51 user nova-compute[72447]:   <serial>9bb2e350-4c8b-4d57-9ca5-592d94123795</serial>
Jul 31 12:34:51 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 12:34:51 user nova-compute[72447]: </disk>
Jul 31 12:34:51 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:34:51 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully detached device vdb from instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 from the persistent domain config.
Jul 31 12:34:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:34:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:34:51 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:34:51 user nova-compute[72447]:   <source dev="/dev/sde"/>
Jul 31 12:34:51 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:34:51 user nova-compute[72447]:   <serial>9bb2e350-4c8b-4d57-9ca5-592d94123795</serial>
Jul 31 12:34:51 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 12:34:51 user nova-compute[72447]: </disk>
Jul 31 12:34:51 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806877.2358472, 0dbd2353-0521-4e92-8722-6151bfb40924 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:34:52 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] VM Stopped (Lifecycle Event)
Jul 31 12:34:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-9aaefb98-36ab-4d5e-89c5-caea83cba9c8 None None] [instance: 0dbd2353-0521-4e92-8722-6151bfb40924] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806892.394463, 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:34:52 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully detached device vdb from instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 from the live domain config.
Jul 31 12:34:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrKlaHuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:34:52 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e138bbf1-c4d7-4b93-84ac-e20b23e5e730]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4288fe-a202-4d8c-930b-ef33cca811f1]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:34:52 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 (non-flash)
Jul 31 12:34:52 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06687b0d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795'): ({'sde'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Removing single pathed devices sde {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[626afd3d-daca-4642-8f54-a89246014510]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df8b6d0-c102-482e-9131-476982a1c178]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Flushing IO for device /dev/sde {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8231d6ff-0569-43d5-95da-80c777d42c9f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0c081b-8ce9-4ab6-ae46-b50d26711c2b]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] SCSI volumes sde have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cbf666-b61a-4b2f-bbeb-a6a92c6b2674]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dce194-a33d-4a53-902c-1e39375df1be]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260]
Jul 31 12:34:52 user nova-compute[72447]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795, portal: 172.16.0.220,3260] successful.
Jul 31 12:34:52 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb2e350-4c8b-4d57-9ca5-592d94123795 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7eb16b-a715-46cc-a343-cdaa3df0d1cf]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] <== disconnect_volume: return (292ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:34:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:34:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:34:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5a1f2e40-7695-4b38-97ec-e87b3dfa6dba tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1ac2e98d-515d-4a59-9d2b-a905db0e7821 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1ac2e98d-515d-4a59-9d2b-a905db0e7821 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1ac2e98d-515d-4a59-9d2b-a905db0e7821 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1ac2e98d-515d-4a59-9d2b-a905db0e7821 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72447) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG nova.objects.instance [None req-1ac2e98d-515d-4a59-9d2b-a905db0e7821 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-9af70412-4ca2-4fd8-90b4-8a8971712274 req-3731ed3b-9ad9-4b30-b807-28a8380c0c04 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-unplugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9af70412-4ca2-4fd8-90b4-8a8971712274 req-3731ed3b-9ad9-4b30-b807-28a8380c0c04 service nova] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9af70412-4ca2-4fd8-90b4-8a8971712274 req-3731ed3b-9ad9-4b30-b807-28a8380c0c04 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9af70412-4ca2-4fd8-90b4-8a8971712274 req-3731ed3b-9ad9-4b30-b807-28a8380c0c04 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:54 user nova-compute[72447]: DEBUG nova.compute.manager [req-9af70412-4ca2-4fd8-90b4-8a8971712274 req-3731ed3b-9ad9-4b30-b807-28a8380c0c04 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] No waiting events found dispatching network-vif-unplugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:34:54 user nova-compute[72447]: WARNING nova.compute.manager [req-9af70412-4ca2-4fd8-90b4-8a8971712274 req-3731ed3b-9ad9-4b30-b807-28a8380c0c04 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received unexpected event network-vif-unplugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 for instance with vm_state active and task_state powering-off.
Jul 31 12:34:54 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance destroyed successfully.
Jul 31 12:34:54 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1ac2e98d-515d-4a59-9d2b-a905db0e7821 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1ac2e98d-515d-4a59-9d2b-a905db0e7821 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.920s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daiycHLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:34:55 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:34:55 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:34:55 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3b5c9a-c287-4dff-b77a-dcb9aad56067]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:34:55 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8055b01b-a007-4769-b545-8664ba889fc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678] added
Jul 31 12:34:55 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9251ebf-33fa-4683-9cdb-2a8bf1d5836d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce5f0a6-f3cb-4a49-9431-eb4b7751596a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v daiycHLY {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v daiycHLY" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[194cd148-1595-4a1f-82f4-b2988b091292]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'daiycHLY'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d9d36a-1d29-4fd3-8b78-e11378e11e96]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[74501c69-cf7b-47ab-a231-303c15654844]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:34:55 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:34:55 user nova-compute[72447]:  {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:34:55 user nova-compute[72447]: WARNING os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 12:34:55 user nova-compute[72447]: 
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a9c91f-ab00-4acb-9624-bbcf765bd4df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678, portal: 172.16.0.220,3260]
Jul 31 12:34:55 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678, portal: 172.16.0.220,3260] successful.
Jul 31 12:34:55 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee5babf-ad32-4f0f-81a9-177e03c4e1cb]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0739bd6-532b-4132-acaf-88433bb7a0b0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 (non-flash)
Jul 31 12:34:55 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 (non-flash)
Jul 31 12:34:55 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7970085-7352-4ccc-8400-44c511d00fab]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:34:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daiycHLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:34:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:34:56 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23034336662346562', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:34:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034336662346562', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:34:56 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'flavor' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:34:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:34:56 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:34:56 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:34:56 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:34:56 user nova-compute[72447]:   <serial>e8797347-1740-493b-b3a3-99a66973c678</serial>
Jul 31 12:34:56 user nova-compute[72447]: </disk>
Jul 31 12:34:56 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:34:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-8797d52d-7808-4a5a-8aa4-b6097d285777 req-e7084a81-27d7-479a-a066-665d9c106c3c service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:34:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8797d52d-7808-4a5a-8aa4-b6097d285777 req-e7084a81-27d7-479a-a066-665d9c106c3c service nova] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8797d52d-7808-4a5a-8aa4-b6097d285777 req-e7084a81-27d7-479a-a066-665d9c106c3c service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-8797d52d-7808-4a5a-8aa4-b6097d285777 req-e7084a81-27d7-479a-a066-665d9c106c3c service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-8797d52d-7808-4a5a-8aa4-b6097d285777 req-e7084a81-27d7-479a-a066-665d9c106c3c service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] No waiting events found dispatching network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:34:56 user nova-compute[72447]: WARNING nova.compute.manager [req-8797d52d-7808-4a5a-8aa4-b6097d285777 req-e7084a81-27d7-479a-a066-665d9c106c3c service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received unexpected event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 for instance with vm_state stopped and task_state None.
Jul 31 12:34:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:34:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:34:56 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No VIF found with MAC fa:16:3e:cb:dd:96, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:34:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3f900423-6295-414d-8f03-21fea182d716 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.688s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:34:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:34:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:34:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:34:59 user nova-compute[72447]: INFO nova.compute.manager [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Detaching volume e8797347-1740-493b-b3a3-99a66973c678
Jul 31 12:34:59 user nova-compute[72447]: INFO nova.virt.block_device [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attempting to driver detach volume e8797347-1740-493b-b3a3-99a66973c678 from mountpoint /dev/vdb
Jul 31 12:34:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Attempting to detach device vdb from instance 6707cbc8-a675-4248-b324-40630ebff478 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:34:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:34:59 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:34:59 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:34:59 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:34:59 user nova-compute[72447]:   <serial>e8797347-1740-493b-b3a3-99a66973c678</serial>
Jul 31 12:34:59 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:34:59 user nova-compute[72447]: </disk>
Jul 31 12:34:59 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:34:59 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Successfully detached device vdb from instance 6707cbc8-a675-4248-b324-40630ebff478 from the persistent domain config.
Jul 31 12:34:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6707cbc8-a675-4248-b324-40630ebff478 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:34:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:34:59 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:34:59 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:34:59 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:34:59 user nova-compute[72447]:   <serial>e8797347-1740-493b-b3a3-99a66973c678</serial>
Jul 31 12:34:59 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:34:59 user nova-compute[72447]: </disk>
Jul 31 12:34:59 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806900.0901902, 6707cbc8-a675-4248-b324-40630ebff478 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:35:00 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Successfully detached device vdb from instance 6707cbc8-a675-4248-b324-40630ebff478 from the live domain config.
Jul 31 12:35:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daiycHLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:35:00 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbeb5f6-f639-44bf-97d4-4a989eb8dc92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[219bba29-cd58-4b60-a9a9-9b103ddb5c47]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 (non-flash)
Jul 31 12:35:00 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 (non-flash)
Jul 31 12:35:00 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f067c5241f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1099fedd-49cf-4a5f-9c10-d3b561e61267]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a21949-dc05-467d-863c-8f990aa072a6]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff954be-fcc4-43a5-9938-3ab83de92197]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e998350c-a04e-4d3e-a811-893b4ff82b9a]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d66089-bc4a-4f23-9d1c-62385c7a3f50]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6897dd8e-aeab-4a6d-bf3d-9aa98e96ddde]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678, portal: 172.16.0.220,3260]
Jul 31 12:35:00 user nova-compute[72447]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678, portal: 172.16.0.220,3260] successful.
Jul 31 12:35:00 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8797347-1740-493b-b3a3-99a66973c678 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[533d4c57-45fc-43c5-892f-5fb19f6879d8]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] <== disconnect_volume: return (275ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:35:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:35:01 user nova-compute[72447]: DEBUG nova.objects.instance [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'flavor' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:35:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-834f4120-a80d-4a15-9ae5-c5f9c68fe568 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.705s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:35:02 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:35:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:07 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:35:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:35:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:35:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:35:07 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:35:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:35:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:08 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updating instance_info_cache with network_info: [{"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:35:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:35:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:35:08 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:35:08 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:35:08 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:35:09 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806894.9427686, 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:35:09 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] VM Stopped (Lifecycle Event)
Jul 31 12:35:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-dcf7f99b-b3f8-4d18-abd6-db17438e3d05 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:35:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-dcf7f99b-b3f8-4d18-abd6-db17438e3d05 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:35:11 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:35:11 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:35:11 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:35:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:14 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:16 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:35:16 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:35:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8282MB free_disk=24.91696548461914GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 51e36718-ed91-4dc5-82db-1f429df14d2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6707cbc8-a675-4248-b324-40630ebff478 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance fdcbf76f-3148-43f5-9c10-358ab668096d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:35:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:35:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:35:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "51e36718-ed91-4dc5-82db-1f429df14d2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:35:27 user nova-compute[72447]: INFO nova.compute.manager [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Terminating instance
Jul 31 12:35:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-e19fc934-8b94-4a76-b227-ff50050a6d93 req-bd3c6483-8a93-4026-bb74-908a672b4147 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Received event network-vif-unplugged-3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e19fc934-8b94-4a76-b227-ff50050a6d93 req-bd3c6483-8a93-4026-bb74-908a672b4147 service nova] Acquiring lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e19fc934-8b94-4a76-b227-ff50050a6d93 req-bd3c6483-8a93-4026-bb74-908a672b4147 service nova] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e19fc934-8b94-4a76-b227-ff50050a6d93 req-bd3c6483-8a93-4026-bb74-908a672b4147 service nova] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-e19fc934-8b94-4a76-b227-ff50050a6d93 req-bd3c6483-8a93-4026-bb74-908a672b4147 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] No waiting events found dispatching network-vif-unplugged-3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG nova.compute.manager [req-e19fc934-8b94-4a76-b227-ff50050a6d93 req-bd3c6483-8a93-4026-bb74-908a672b4147 service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Received event network-vif-unplugged-3f2a18de-e66e-4924-9216-cbd14e4aa8de for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Instance destroyed successfully.
Jul 31 12:35:27 user nova-compute[72447]: DEBUG nova.objects.instance [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lazy-loading 'resources' on Instance uuid 51e36718-ed91-4dc5-82db-1f429df14d2f {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1369190453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1369190453',id=15,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a055fae579aa4858867824625e8bd18d',ramdisk_id='',reservation_id='r-07tpwfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:17:44Z,user_data=None,user_id='33268392189342ecbca53c9ad959245e',uuid=51e36718-ed91-4dc5-82db-1f429df14d2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "address": "fa:16:3e:4e:fc:4a", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a18de-e6", "ovs_interfaceid": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converting VIF {"id": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "address": "fa:16:3e:4e:fc:4a", "network": {"id": "c9d8b297-5b58-4959-9bdb-39a32a3b7ef1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-852181880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a055fae579aa4858867824625e8bd18d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a18de-e6", "ovs_interfaceid": "3f2a18de-e66e-4924-9216-cbd14e4aa8de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:fc:4a,bridge_name='br-int',has_traffic_filtering=True,id=3f2a18de-e66e-4924-9216-cbd14e4aa8de,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a18de-e6') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG os_vif [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:fc:4a,bridge_name='br-int',has_traffic_filtering=True,id=3f2a18de-e66e-4924-9216-cbd14e4aa8de,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a18de-e6') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f2a18de-e6, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:27 user nova-compute[72447]: INFO os_vif [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:fc:4a,bridge_name='br-int',has_traffic_filtering=True,id=3f2a18de-e66e-4924-9216-cbd14e4aa8de,network=Network(c9d8b297-5b58-4959-9bdb-39a32a3b7ef1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a18de-e6')
Jul 31 12:35:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Deleting instance files /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f_del
Jul 31 12:35:27 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Deletion of /opt/stack/data/nova/instances/51e36718-ed91-4dc5-82db-1f429df14d2f_del complete
Jul 31 12:35:27 user nova-compute[72447]: INFO nova.compute.manager [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Took 0.68 seconds to destroy the instance on the hypervisor.
Jul 31 12:35:27 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:35:27 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:35:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:28 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:35:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:28 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Took 0.57 seconds to deallocate network for instance.
Jul 31 12:35:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:35:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:35:28 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:35:28 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:35:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:35:28 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Deleted allocations for instance 51e36718-ed91-4dc5-82db-1f429df14d2f
Jul 31 12:35:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-24d48de3-0902-4640-a2c3-a8e03eb75744 tempest-ServerBootFromVolumeStableRescueTest-1637857313 tempest-ServerBootFromVolumeStableRescueTest-1637857313-project-member] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.662s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:35:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-625d6eb8-441d-4b61-83d3-65360de298ab req-85bad7b2-cbb5-4fab-b30b-821df53514ce service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Received event network-vif-plugged-3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:35:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-625d6eb8-441d-4b61-83d3-65360de298ab req-85bad7b2-cbb5-4fab-b30b-821df53514ce service nova] Acquiring lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:35:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-625d6eb8-441d-4b61-83d3-65360de298ab req-85bad7b2-cbb5-4fab-b30b-821df53514ce service nova] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:35:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-625d6eb8-441d-4b61-83d3-65360de298ab req-85bad7b2-cbb5-4fab-b30b-821df53514ce service nova] Lock "51e36718-ed91-4dc5-82db-1f429df14d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:35:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-625d6eb8-441d-4b61-83d3-65360de298ab req-85bad7b2-cbb5-4fab-b30b-821df53514ce service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] No waiting events found dispatching network-vif-plugged-3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:35:29 user nova-compute[72447]: WARNING nova.compute.manager [req-625d6eb8-441d-4b61-83d3-65360de298ab req-85bad7b2-cbb5-4fab-b30b-821df53514ce service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Received unexpected event network-vif-plugged-3f2a18de-e66e-4924-9216-cbd14e4aa8de for instance with vm_state deleted and task_state None.
Jul 31 12:35:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-625d6eb8-441d-4b61-83d3-65360de298ab req-85bad7b2-cbb5-4fab-b30b-821df53514ce service nova] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Received event network-vif-deleted-3f2a18de-e66e-4924-9216-cbd14e4aa8de {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:35:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:35:42 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690806927.8350403, 51e36718-ed91-4dc5-82db-1f429df14d2f => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:35:42 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] VM Stopped (Lifecycle Event)
Jul 31 12:35:42 user nova-compute[72447]: DEBUG nova.compute.manager [None req-2b1db7f1-9ddf-4ce4-aed2-03c866bd6ccb None None] [instance: 51e36718-ed91-4dc5-82db-1f429df14d2f] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:35:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:35:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:35:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:35:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:35:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'flavor' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.046s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:35:53 user nova-compute[72447]: INFO nova.compute.manager [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attaching volume 78cddcbc-9c2b-494e-ad75-0e25ddac6580 to /dev/vdb
Jul 31 12:35:53 user nova-compute[72447]: DEBUG os_brick.utils [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[342e3a53-f51e-4ff9-86cb-baf4c8b9b9c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[357718cf-29eb-4876-8d9f-fece16699f84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db16ef4-ce74-429f-b400-0253b69c33f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02567ea-e9a4-4af8-abc7-0c6bd34cd6a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:35:53 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:35:54 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:35:54 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:35:54 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0881fa0-f562-4d96-8e64-56cb886b1a3d]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:35:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:35:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:35:54 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:35:54 user nova-compute[72447]: DEBUG os_brick.utils [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:35:54 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Updating existing volume attachment record: d32fa82e-cc60-4878-ab6e-1074bf3e8c7b {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:35:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:35:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vjgWRMUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:36:00 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:36:00 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:36:00 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7036600a-1d54-494b-87ca-1f9115e4d7d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:36:00 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b41a217-ff6a-4983-aaa6-cb89273d8606]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580] added
Jul 31 12:36:00 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19825a0-9ce7-40e8-ae58-9a10f15a5baf]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[61762bac-27c2-4f40-9cc6-7eab0586578a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vjgWRMUX {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vjgWRMUX" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e023b6a-0d7a-414f-baef-f82c75f53850]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vjgWRMUX'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[373a718c-8348-495c-b39f-2803dc4b7a86]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[350e294f-e289-4cdb-be28-8442a145b968]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:36:00 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:36:00 user nova-compute[72447]:  {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:36:00 user nova-compute[72447]: WARNING os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 12:36:00 user nova-compute[72447]: 
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0da5fd4-0387-4e08-a55a-4a53d065fd46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580, portal: 172.16.0.220,3260]
Jul 31 12:36:00 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580, portal: 172.16.0.220,3260] successful.
Jul 31 12:36:00 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:36:00 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d2d0ab-54c9-40c1-be63-7e4aabe515a0]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b129ba6-c0f8-4ac6-8fc4-81dfbcb283dc]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 (non-flash)
Jul 31 12:36:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 (non-flash)
Jul 31 12:36:01 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[183d0d0f-7bba-4413-9142-d89a8cb08719]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:01 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:36:02 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:36:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vjgWRMUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:36:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:36:02 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26635333439396133', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:36:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635333439396133', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:36:02 user nova-compute[72447]: DEBUG nova.objects.instance [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'flavor' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:36:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:36:02 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:36:02 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:36:02 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:36:02 user nova-compute[72447]:   <serial>78cddcbc-9c2b-494e-ad75-0e25ddac6580</serial>
Jul 31 12:36:02 user nova-compute[72447]: </disk>
Jul 31 12:36:02 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:36:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:36:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:36:02 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No VIF found with MAC fa:16:3e:cb:dd:96, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:36:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-78e484e7-5420-4614-9e89-d7bde08d4a91 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.812s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:36:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:36:05 user nova-compute[72447]: INFO nova.compute.manager [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Detaching volume 78cddcbc-9c2b-494e-ad75-0e25ddac6580
Jul 31 12:36:05 user nova-compute[72447]: INFO nova.virt.block_device [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attempting to driver detach volume 78cddcbc-9c2b-494e-ad75-0e25ddac6580 from mountpoint /dev/vdb
Jul 31 12:36:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Attempting to detach device vdb from instance 6707cbc8-a675-4248-b324-40630ebff478 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:36:05 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:36:05 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:36:05 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:36:05 user nova-compute[72447]:   <serial>78cddcbc-9c2b-494e-ad75-0e25ddac6580</serial>
Jul 31 12:36:05 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:36:05 user nova-compute[72447]: </disk>
Jul 31 12:36:05 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:36:05 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Successfully detached device vdb from instance 6707cbc8-a675-4248-b324-40630ebff478 from the persistent domain config.
Jul 31 12:36:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6707cbc8-a675-4248-b324-40630ebff478 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:36:05 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:36:05 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:36:05 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:36:05 user nova-compute[72447]:   <serial>78cddcbc-9c2b-494e-ad75-0e25ddac6580</serial>
Jul 31 12:36:05 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:36:05 user nova-compute[72447]: </disk>
Jul 31 12:36:05 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690806965.694243, 6707cbc8-a675-4248-b324-40630ebff478 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:36:05 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Successfully detached device vdb from instance 6707cbc8-a675-4248-b324-40630ebff478 from the live domain config.
Jul 31 12:36:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vjgWRMUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:36:05 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee52979e-5871-428f-b65e-fe9e1233622f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac82608-94e9-4ce1-b173-bd90a5b58b5e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 (non-flash)
Jul 31 12:36:05 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 (non-flash)
Jul 31 12:36:05 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f066858ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2ce13f-ac5b-4558-bed7-28a11a66c7c1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e631b97-4616-4571-b5f9-d87e8ed8d1f5]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81268fc-40f1-4300-a8e5-ac942ec574a1]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7c23f1-55af-4a48-8b40-d19e6522f01c]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e28612-5e68-4fb2-a93c-3cef1003bf18]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa030a12-bfd2-44ac-a7b9-90c3776d317c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580, portal: 172.16.0.220,3260]
Jul 31 12:36:05 user nova-compute[72447]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580, portal: 172.16.0.220,3260] successful.
Jul 31 12:36:05 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78cddcbc-9c2b-494e-ad75-0e25ddac6580 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e2011a-e1db-4414-9cf0-e7042b7f1d8b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] <== disconnect_volume: return (254ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:36:05 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:36:06 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'flavor' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:36:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4eb94d45-7d29-4164-84fb-86e8a3d675ab tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.530s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:36:07 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:36:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:36:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:08 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:36:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:36:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:36:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:36:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:36:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:36:09 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:36:09 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid d4bd5550-6cd3-4177-afbd-1e4981eeec99 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:36:09 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Updating instance_info_cache with network_info: [{"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:36:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:36:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:36:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:11 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:36:11 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:36:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:13 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:16 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:36:16 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:36:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8477MB free_disk=25.040481567382812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:36:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:36:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:36:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:36:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:36:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6707cbc8-a675-4248-b324-40630ebff478 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:36:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance fdcbf76f-3148-43f5-9c10-358ab668096d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:36:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:36:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:36:17 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:36:17 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:36:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:36:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:36:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:36:18 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:36:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:36:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:36:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:36:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:36:44 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:36:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:36:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquired lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:36:44 user nova-compute[72447]: DEBUG nova.network.neutron [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:36:44 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'info_cache' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.network.neutron [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updating instance_info_cache with network_info: [{"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Releasing lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:36:46 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance destroyed successfully.
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'resources' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:28:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-675334656',display_name='tempest-AttachVolumeTestJSON-server-675334656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-675334656',id=39,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjaiwoFel2Eh2TCakrkW9agvz+yoDwe/zWXpzkLHB0ZWZVJFVho0opNQvvQrNB2zUmhAKykfMwu2NDRbQKV/RDfX39Ice4f0JVuhVt96pRXbOIBk6k5FqAJVOMHKQRawg==',key_name='tempest-keypair-1537936122',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f7c1764cced4b49ad8e55759362a8db',ramdisk_id='',reservation_id='r-p6axrgt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-182433734',owner_user_name='tempest-AttachVolumeTestJSON-182433734-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33486507bb4141d1a1753054199bce56',uuid=43b9c1c3-280c-4c26-9435-e50d29b3d8d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converting VIF {"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG os_vif [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23148cca-e5, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:36:46 user nova-compute[72447]: INFO os_vif [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5')
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Start _get_guest_xml network_info=[{"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'numa_topology' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:36:46 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:36:46 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'vcpu_model' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:28:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-675334656',display_name='tempest-AttachVolumeTestJSON-server-675334656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-675334656',id=39,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjaiwoFel2Eh2TCakrkW9agvz+yoDwe/zWXpzkLHB0ZWZVJFVho0opNQvvQrNB2zUmhAKykfMwu2NDRbQKV/RDfX39Ice4f0JVuhVt96pRXbOIBk6k5FqAJVOMHKQRawg==',key_name='tempest-keypair-1537936122',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f7c1764cced4b49ad8e55759362a8db',ramdisk_id='',reservation_id='r-p6axrgt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-182433734',owner_user_name='tempest-AttachVolumeTestJSON-182433734-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33486507bb4141d1a1753054199bce56',uuid=43b9c1c3-280c-4c26-9435-e50d29b3d8d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converting VIF {"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'pci_devices' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:36:46 user nova-compute[72447]:   <uuid>43b9c1c3-280c-4c26-9435-e50d29b3d8d6</uuid>
Jul 31 12:36:46 user nova-compute[72447]:   <name>instance-00000027</name>
Jul 31 12:36:46 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:36:46 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:36:46 user nova-compute[72447]:   <metadata>
Jul 31 12:36:46 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:36:46 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:36:46 user nova-compute[72447]:       <nova:name>tempest-AttachVolumeTestJSON-server-675334656</nova:name>
Jul 31 12:36:46 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:36:46</nova:creationTime>
Jul 31 12:36:46 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:36:46 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:36:46 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:36:46 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:36:46 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:36:46 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:36:46 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:36:46 user nova-compute[72447]:       <nova:owner>
Jul 31 12:36:46 user nova-compute[72447]:         <nova:user uuid="33486507bb4141d1a1753054199bce56">tempest-AttachVolumeTestJSON-182433734-project-member</nova:user>
Jul 31 12:36:46 user nova-compute[72447]:         <nova:project uuid="6f7c1764cced4b49ad8e55759362a8db">tempest-AttachVolumeTestJSON-182433734</nova:project>
Jul 31 12:36:46 user nova-compute[72447]:       </nova:owner>
Jul 31 12:36:46 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:36:46 user nova-compute[72447]:       <nova:ports>
Jul 31 12:36:46 user nova-compute[72447]:         <nova:port uuid="23148cca-e577-4eaa-ab83-b87a4d7dd713">
Jul 31 12:36:46 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 12:36:46 user nova-compute[72447]:         </nova:port>
Jul 31 12:36:46 user nova-compute[72447]:       </nova:ports>
Jul 31 12:36:46 user nova-compute[72447]:     </nova:instance>
Jul 31 12:36:46 user nova-compute[72447]:   </metadata>
Jul 31 12:36:46 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:36:46 user nova-compute[72447]:     <system>
Jul 31 12:36:46 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:36:46 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:36:46 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:36:46 user nova-compute[72447]:       <entry name="serial">43b9c1c3-280c-4c26-9435-e50d29b3d8d6</entry>
Jul 31 12:36:46 user nova-compute[72447]:       <entry name="uuid">43b9c1c3-280c-4c26-9435-e50d29b3d8d6</entry>
Jul 31 12:36:46 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:36:46 user nova-compute[72447]:     </system>
Jul 31 12:36:46 user nova-compute[72447]:   </sysinfo>
Jul 31 12:36:46 user nova-compute[72447]:   <os>
Jul 31 12:36:46 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:36:46 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:36:46 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:36:46 user nova-compute[72447]:   </os>
Jul 31 12:36:46 user nova-compute[72447]:   <features>
Jul 31 12:36:46 user nova-compute[72447]:     <acpi/>
Jul 31 12:36:46 user nova-compute[72447]:     <apic/>
Jul 31 12:36:46 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:36:46 user nova-compute[72447]:   </features>
Jul 31 12:36:46 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:36:46 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:36:46 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:36:46 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:36:46 user nova-compute[72447]:   </clock>
Jul 31 12:36:46 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:36:46 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:36:46 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:36:46 user nova-compute[72447]:   </cpu>
Jul 31 12:36:46 user nova-compute[72447]:   <devices>
Jul 31 12:36:46 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:36:46 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:36:46 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk"/>
Jul 31 12:36:46 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:36:46 user nova-compute[72447]:     </disk>
Jul 31 12:36:46 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:36:46 user nova-compute[72447]:       <mac address="fa:16:3e:0c:31:61"/>
Jul 31 12:36:46 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:36:46 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:36:46 user nova-compute[72447]:       <target dev="tap23148cca-e5"/>
Jul 31 12:36:46 user nova-compute[72447]:     </interface>
Jul 31 12:36:46 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:36:46 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/console.log" append="off"/>
Jul 31 12:36:46 user nova-compute[72447]:     </serial>
Jul 31 12:36:46 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:36:46 user nova-compute[72447]:     <video>
Jul 31 12:36:46 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:36:46 user nova-compute[72447]:     </video>
Jul 31 12:36:46 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:36:46 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:36:46 user nova-compute[72447]:     </rng>
Jul 31 12:36:46 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:36:46 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:36:46 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:36:46 user nova-compute[72447]:     </memballoon>
Jul 31 12:36:46 user nova-compute[72447]:   </devices>
Jul 31 12:36:46 user nova-compute[72447]: </domain>
Jul 31 12:36:46 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'trusted_certs' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:36:46 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Cannot resize image /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'migration_context' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:28:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-675334656',display_name='tempest-AttachVolumeTestJSON-server-675334656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-675334656',id=39,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjaiwoFel2Eh2TCakrkW9agvz+yoDwe/zWXpzkLHB0ZWZVJFVho0opNQvvQrNB2zUmhAKykfMwu2NDRbQKV/RDfX39Ice4f0JVuhVt96pRXbOIBk6k5FqAJVOMHKQRawg==',key_name='tempest-keypair-1537936122',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6f7c1764cced4b49ad8e55759362a8db',ramdisk_id='',reservation_id='r-p6axrgt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-182433734',owner_user_name='tempest-AttachVolumeTestJSON-182433734-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33486507bb4141d1a1753054199bce56',uuid=43b9c1c3-280c-4c26-9435-e50d29b3d8d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converting VIF {"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG os_vif [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23148cca-e5, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23148cca-e5, col_values=(('external_ids', {'iface-id': '23148cca-e577-4eaa-ab83-b87a4d7dd713', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:31:61', 'vm-uuid': '43b9c1c3-280c-4c26-9435-e50d29b3d8d6'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:36:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:47 user nova-compute[72447]: INFO os_vif [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5')
Jul 31 12:36:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-eb3c3cbd-ccb4-4bd2-890e-e4d23e5179cb req-2a877710-bf1e-4773-99fb-20e7bfe7bf74 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:36:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-eb3c3cbd-ccb4-4bd2-890e-e4d23e5179cb req-2a877710-bf1e-4773-99fb-20e7bfe7bf74 service nova] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:36:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-eb3c3cbd-ccb4-4bd2-890e-e4d23e5179cb req-2a877710-bf1e-4773-99fb-20e7bfe7bf74 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:36:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-eb3c3cbd-ccb4-4bd2-890e-e4d23e5179cb req-2a877710-bf1e-4773-99fb-20e7bfe7bf74 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:36:48 user nova-compute[72447]: DEBUG nova.compute.manager [req-eb3c3cbd-ccb4-4bd2-890e-e4d23e5179cb req-2a877710-bf1e-4773-99fb-20e7bfe7bf74 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] No waiting events found dispatching network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:36:48 user nova-compute[72447]: WARNING nova.compute.manager [req-eb3c3cbd-ccb4-4bd2-890e-e4d23e5179cb req-2a877710-bf1e-4773-99fb-20e7bfe7bf74 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received unexpected event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 for instance with vm_state stopped and task_state powering-on.
Jul 31 12:36:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:50 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807010.5493057, 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:36:50 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] VM Resumed (Lifecycle Event)
Jul 31 12:36:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:36:50 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance rebooted successfully.
Jul 31 12:36:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4f86e844-b40f-41f2-a684-1155d1438569 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:36:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:36:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:36:50 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 31 12:36:50 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807010.5508442, 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:36:50 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] VM Started (Lifecycle Event)
Jul 31 12:36:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:36:50 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:36:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-cb1d3ebf-8c23-4a5b-b6b9-1ea81b171f8d req-1fd26c24-d294-4e62-a1d6-a03239eb6988 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:36:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cb1d3ebf-8c23-4a5b-b6b9-1ea81b171f8d req-1fd26c24-d294-4e62-a1d6-a03239eb6988 service nova] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:36:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cb1d3ebf-8c23-4a5b-b6b9-1ea81b171f8d req-1fd26c24-d294-4e62-a1d6-a03239eb6988 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:36:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cb1d3ebf-8c23-4a5b-b6b9-1ea81b171f8d req-1fd26c24-d294-4e62-a1d6-a03239eb6988 service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:36:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-cb1d3ebf-8c23-4a5b-b6b9-1ea81b171f8d req-1fd26c24-d294-4e62-a1d6-a03239eb6988 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] No waiting events found dispatching network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:36:50 user nova-compute[72447]: WARNING nova.compute.manager [req-cb1d3ebf-8c23-4a5b-b6b9-1ea81b171f8d req-1fd26c24-d294-4e62-a1d6-a03239eb6988 service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received unexpected event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 for instance with vm_state active and task_state None.
Jul 31 12:36:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG nova.objects.instance [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'flavor' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:36:59 user nova-compute[72447]: INFO nova.compute.manager [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attaching volume 7d6fbade-374b-4b66-947d-90f15fce2892 to /dev/vdb
Jul 31 12:36:59 user nova-compute[72447]: DEBUG os_brick.utils [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa31bc74-71b9-44c1-857c-5b03f6742795]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd577268-8abb-4ea0-8163-8e0bd7683600]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a40392-3feb-405c-ba6a-88d0f77f74ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[58befbb0-909e-498f-9eda-15f1bf512c65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:36:59 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:36:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e126af9-3ce3-463a-811b-a0b26499eaab]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG os_brick.utils [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:36:59 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Updating existing volume attachment record: 4ec34871-1c63-4acb-8ab1-3df3b84b4805 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:37:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:01 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG nova.compute.manager [req-629362e2-885f-4eff-9ffc-389e4eb5cda5 req-a12f929a-c912-47e2-8bf2-651327aa10d4 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Received event network-changed-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG nova.compute.manager [req-629362e2-885f-4eff-9ffc-389e4eb5cda5 req-a12f929a-c912-47e2-8bf2-651327aa10d4 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Refreshing instance network info cache due to event network-changed-148f60a6-1d5e-4b9b-9f8c-f199bb48f252. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-629362e2-885f-4eff-9ffc-389e4eb5cda5 req-a12f929a-c912-47e2-8bf2-651327aa10d4 service nova] Acquiring lock "refresh_cache-fdcbf76f-3148-43f5-9c10-358ab668096d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-629362e2-885f-4eff-9ffc-389e4eb5cda5 req-a12f929a-c912-47e2-8bf2-651327aa10d4 service nova] Acquired lock "refresh_cache-fdcbf76f-3148-43f5-9c10-358ab668096d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG nova.network.neutron [req-629362e2-885f-4eff-9ffc-389e4eb5cda5 req-a12f929a-c912-47e2-8bf2-651327aa10d4 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Refreshing network info cache for port 148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "fdcbf76f-3148-43f5-9c10-358ab668096d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:37:03 user nova-compute[72447]: INFO nova.compute.manager [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Terminating instance
Jul 31 12:37:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG nova.network.neutron [req-629362e2-885f-4eff-9ffc-389e4eb5cda5 req-a12f929a-c912-47e2-8bf2-651327aa10d4 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Updated VIF entry in instance network info cache for port 148f60a6-1d5e-4b9b-9f8c-f199bb48f252. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG nova.network.neutron [req-629362e2-885f-4eff-9ffc-389e4eb5cda5 req-a12f929a-c912-47e2-8bf2-651327aa10d4 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Updating instance_info_cache with network_info: [{"id": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "address": "fa:16:3e:b5:b6:a8", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148f60a6-1d", "ovs_interfaceid": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-629362e2-885f-4eff-9ffc-389e4eb5cda5 req-a12f929a-c912-47e2-8bf2-651327aa10d4 service nova] Releasing lock "refresh_cache-fdcbf76f-3148-43f5-9c10-358ab668096d" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:04 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Instance destroyed successfully.
Jul 31 12:37:04 user nova-compute[72447]: DEBUG nova.objects.instance [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lazy-loading 'resources' on Instance uuid fdcbf76f-3148-43f5-9c10-358ab668096d {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1727105472',display_name='tempest-TestStampPattern-server-1727105472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1727105472',id=43,image_ref='64000c41-0014-41a4-b1ff-039785a74893',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyqS6WM/VxoajJCxkzqFbYmyaWdRi6cEk7Qi4JAyZ2mMuFpcq2L/28ah02VGBE9ktZbXYHxyezmKduAO5nTjd+L4At4n2ckFxT9WdPLRl0ZpDmeip6oN8T4/B1+t44T7g==',key_name='tempest-TestStampPattern-2046413804',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:32:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20fef08187154b7da8fc1af9e8960a1b',ramdisk_id='',reservation_id='r-tps3tq49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d4bd5550-6cd3-4177-afbd-1e4981eeec99',image_min_disk='1',image_min_ram='0',image_owner_id='20fef08187154b7da8fc1af9e8960a1b',image_owner_project_name='tempest-TestStampPattern-1760569238',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1760569238-project-member',image_user_id='55651d199ea94f2085d7f2950da100f9',owner_project_name='tempest-TestStampPattern-1760569238',owner_user_name='tempest-TestStampPattern-1760569238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:32:01Z,user_data=None,user_id='55651d199ea94f2085d7f2950da100f9',uuid=fdcbf76f-3148-43f5-9c10-358ab668096d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "address": "fa:16:3e:b5:b6:a8", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148f60a6-1d", "ovs_interfaceid": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Converting VIF {"id": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "address": "fa:16:3e:b5:b6:a8", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148f60a6-1d", "ovs_interfaceid": "148f60a6-1d5e-4b9b-9f8c-f199bb48f252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b6:a8,bridge_name='br-int',has_traffic_filtering=True,id=148f60a6-1d5e-4b9b-9f8c-f199bb48f252,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148f60a6-1d') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG os_vif [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b6:a8,bridge_name='br-int',has_traffic_filtering=True,id=148f60a6-1d5e-4b9b-9f8c-f199bb48f252,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148f60a6-1d') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap148f60a6-1d, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:37:04 user nova-compute[72447]: INFO os_vif [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b6:a8,bridge_name='br-int',has_traffic_filtering=True,id=148f60a6-1d5e-4b9b-9f8c-f199bb48f252,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148f60a6-1d')
Jul 31 12:37:04 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Deleting instance files /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d_del
Jul 31 12:37:04 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Deletion of /opt/stack/data/nova/instances/fdcbf76f-3148-43f5-9c10-358ab668096d_del complete
Jul 31 12:37:04 user nova-compute[72447]: INFO nova.compute.manager [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Took 0.76 seconds to destroy the instance on the hypervisor.
Jul 31 12:37:04 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:37:04 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:37:04 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Took 0.61 seconds to deallocate network for instance.
Jul 31 12:37:04 user nova-compute[72447]: DEBUG nova.compute.manager [req-06bfe4db-4332-405c-9d07-a414d4b0e638 req-0bfba3a7-fb5e-426a-b2c9-6df98eab6dcd service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Received event network-vif-deleted-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:37:04 user nova-compute[72447]: INFO nova.compute.manager [req-06bfe4db-4332-405c-9d07-a414d4b0e638 req-0bfba3a7-fb5e-426a-b2c9-6df98eab6dcd service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Neutron deleted interface 148f60a6-1d5e-4b9b-9f8c-f199bb48f252; detaching it from the instance and deleting it from the info cache
Jul 31 12:37:04 user nova-compute[72447]: DEBUG nova.network.neutron [req-06bfe4db-4332-405c-9d07-a414d4b0e638 req-0bfba3a7-fb5e-426a-b2c9-6df98eab6dcd service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-06bfe4db-4332-405c-9d07-a414d4b0e638 req-0bfba3a7-fb5e-426a-b2c9-6df98eab6dcd service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Detach interface failed, port_id=148f60a6-1d5e-4b9b-9f8c-f199bb48f252, reason: Instance fdcbf76f-3148-43f5-9c10-358ab668096d could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:37:05 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Deleted allocations for instance fdcbf76f-3148-43f5-9c10-358ab668096d
Jul 31 12:37:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-76bf7193-1ea1-4448-a273-4f6c9913701f tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.773s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-24d00071-5206-4cb7-87eb-07a3afc25635 req-4f39255a-aab5-43fa-b329-28e0cba19f24 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Received event network-vif-unplugged-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-24d00071-5206-4cb7-87eb-07a3afc25635 req-4f39255a-aab5-43fa-b329-28e0cba19f24 service nova] Acquiring lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-24d00071-5206-4cb7-87eb-07a3afc25635 req-4f39255a-aab5-43fa-b329-28e0cba19f24 service nova] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-24d00071-5206-4cb7-87eb-07a3afc25635 req-4f39255a-aab5-43fa-b329-28e0cba19f24 service nova] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-24d00071-5206-4cb7-87eb-07a3afc25635 req-4f39255a-aab5-43fa-b329-28e0cba19f24 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] No waiting events found dispatching network-vif-unplugged-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:37:05 user nova-compute[72447]: WARNING nova.compute.manager [req-24d00071-5206-4cb7-87eb-07a3afc25635 req-4f39255a-aab5-43fa-b329-28e0cba19f24 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Received unexpected event network-vif-unplugged-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 for instance with vm_state deleted and task_state None.
Jul 31 12:37:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-24d00071-5206-4cb7-87eb-07a3afc25635 req-4f39255a-aab5-43fa-b329-28e0cba19f24 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Received event network-vif-plugged-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-24d00071-5206-4cb7-87eb-07a3afc25635 req-4f39255a-aab5-43fa-b329-28e0cba19f24 service nova] Acquiring lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-24d00071-5206-4cb7-87eb-07a3afc25635 req-4f39255a-aab5-43fa-b329-28e0cba19f24 service nova] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-24d00071-5206-4cb7-87eb-07a3afc25635 req-4f39255a-aab5-43fa-b329-28e0cba19f24 service nova] Lock "fdcbf76f-3148-43f5-9c10-358ab668096d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:37:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-24d00071-5206-4cb7-87eb-07a3afc25635 req-4f39255a-aab5-43fa-b329-28e0cba19f24 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] No waiting events found dispatching network-vif-plugged-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:37:05 user nova-compute[72447]: WARNING nova.compute.manager [req-24d00071-5206-4cb7-87eb-07a3afc25635 req-4f39255a-aab5-43fa-b329-28e0cba19f24 service nova] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Received unexpected event network-vif-plugged-148f60a6-1d5e-4b9b-9f8c-f199bb48f252 for instance with vm_state deleted and task_state None.
Jul 31 12:37:06 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:37:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmyFrziN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:37:06 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:37:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:37:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:37:06 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:37:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:37:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:37:06 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:37:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:06 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece34887-9454-417e-9ac0-cc38182d9ee8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:06 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:37:06 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:37:06 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2c92f4-2b2a-40c9-8caa-8a0c08451456]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892] added
Jul 31 12:37:07 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df34aff-c597-4fdb-9afd-fccbf803fe65]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae1c9cb-5ffa-46bc-9bb8-37a9b9144c98]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmyFrziN {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmyFrziN" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8569d0d6-db31-4d1f-b1b6-fadb11badf69]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cmyFrziN'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[16881e6f-6140-4fea-b72d-64da9398e604]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c658ae-88a2-48bb-84ac-8bfbdf1ae648]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:37:07 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:37:07 user nova-compute[72447]:  {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:37:07 user nova-compute[72447]: WARNING os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 12:37:07 user nova-compute[72447]: 
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe5dfbb-a80d-45b8-8fb7-82bff433aebd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892, portal: 172.16.0.220,3260]
Jul 31 12:37:07 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892, portal: 172.16.0.220,3260] successful.
Jul 31 12:37:07 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8057aed1-9338-448b-9700-4509da7043cd]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[108ad6fe-48b0-4f50-88c9-d58a978c32cf]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 (non-flash)
Jul 31 12:37:07 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 (non-flash)
Jul 31 12:37:07 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d95388-0e6b-4a03-85ee-9f7e4bd0770e]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmyFrziN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:37:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:37:08 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23538366432383966', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:37:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538366432383966', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:37:08 user nova-compute[72447]: DEBUG nova.objects.instance [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'flavor' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:37:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:37:08 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:37:08 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:37:08 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:37:08 user nova-compute[72447]:   <serial>7d6fbade-374b-4b66-947d-90f15fce2892</serial>
Jul 31 12:37:08 user nova-compute[72447]: </disk>
Jul 31 12:37:08 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:37:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:37:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:37:08 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] No VIF found with MAC fa:16:3e:cb:dd:96, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:37:08 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-afc060c5-4713-4a29-8a77-78d1db603b40 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.126s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:37:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:37:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:37:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:37:09 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:37:09 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updating instance_info_cache with network_info: [{"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:37:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-43b9c1c3-280c-4c26-9435-e50d29b3d8d6" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:37:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:37:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:37:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:37:10 user nova-compute[72447]: INFO nova.compute.manager [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Detaching volume 7d6fbade-374b-4b66-947d-90f15fce2892
Jul 31 12:37:10 user nova-compute[72447]: INFO nova.virt.block_device [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Attempting to driver detach volume 7d6fbade-374b-4b66-947d-90f15fce2892 from mountpoint /dev/vdb
Jul 31 12:37:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Attempting to detach device vdb from instance 6707cbc8-a675-4248-b324-40630ebff478 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:37:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:37:10 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:37:10 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:37:10 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:37:10 user nova-compute[72447]:   <serial>7d6fbade-374b-4b66-947d-90f15fce2892</serial>
Jul 31 12:37:10 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:37:10 user nova-compute[72447]: </disk>
Jul 31 12:37:10 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:37:10 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Successfully detached device vdb from instance 6707cbc8-a675-4248-b324-40630ebff478 from the persistent domain config.
Jul 31 12:37:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6707cbc8-a675-4248-b324-40630ebff478 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:37:10 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:37:10 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:37:10 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:37:10 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:37:10 user nova-compute[72447]:   <serial>7d6fbade-374b-4b66-947d-90f15fce2892</serial>
Jul 31 12:37:10 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:37:10 user nova-compute[72447]: </disk>
Jul 31 12:37:10 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690807031.3443837, 6707cbc8-a675-4248-b324-40630ebff478 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:37:11 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Successfully detached device vdb from instance 6707cbc8-a675-4248-b324-40630ebff478 from the live domain config.
Jul 31 12:37:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmyFrziN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:37:11 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc5797e-d044-456b-a7a5-c09aab22abf2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[742c7e3a-6b04-4476-8053-9d5010b648c1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 (non-flash)
Jul 31 12:37:11 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 (non-flash)
Jul 31 12:37:11 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06681da200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f26919-c701-4869-830a-95af31a9a8a9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0592a4e7-649a-4a6a-a788-b7c5027ff687]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf43082-b3c8-4a60-a6fe-fd08fd7eb83d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd4f4fa-eccb-4f4b-9aa7-1a203689fe92]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8fbd43-1ab4-4d24-9eb5-1ecb87210e39]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16e5a68-8aad-44f1-9594-655045842c38]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892, portal: 172.16.0.220,3260]
Jul 31 12:37:11 user nova-compute[72447]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892, portal: 172.16.0.220,3260] successful.
Jul 31 12:37:11 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6fbade-374b-4b66-947d-90f15fce2892 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac1fd85-20ef-45a7-bd4d-41c9277a56f3]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] <== disconnect_volume: return (264ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:37:11 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:37:12 user nova-compute[72447]: DEBUG nova.objects.instance [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'flavor' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:37:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b11c9f90-20d3-4032-8d8b-a26907338a2a tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.596s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:37:13 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:13 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:13 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72447) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 12:37:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:37:16 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:37:16 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:37:16 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:37:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8380MB free_disk=25.030288696289062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:37:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:37:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance d4bd5550-6cd3-4177-afbd-1e4981eeec99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6707cbc8-a675-4248-b324-40630ebff478 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing inventories for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating ProviderTree inventory for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing aggregate associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, aggregates: None {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing trait associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:37:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:37:18 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:19 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690807024.2345057, fdcbf76f-3148-43f5-9c10-358ab668096d => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:37:19 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] VM Stopped (Lifecycle Event)
Jul 31 12:37:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fababcfb-7466-4e82-81d4-4ac0fbf62426 None None] [instance: fdcbf76f-3148-43f5-9c10-358ab668096d] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:37:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:21 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 12:37:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] There are 0 instances to clean {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 12:37:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:37:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:37:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:37:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:37:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:37:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:37:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:38:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-bef2fe0a-484b-4251-b1fe-26517d8baf4a req-3587f2e9-8ae2-4adf-8fd2-71b4efc14a06 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Received event network-changed-3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-bef2fe0a-484b-4251-b1fe-26517d8baf4a req-3587f2e9-8ae2-4adf-8fd2-71b4efc14a06 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Refreshing instance network info cache due to event network-changed-3d8642ff-7536-43c2-b539-addb31e07e9c. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bef2fe0a-484b-4251-b1fe-26517d8baf4a req-3587f2e9-8ae2-4adf-8fd2-71b4efc14a06 service nova] Acquiring lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bef2fe0a-484b-4251-b1fe-26517d8baf4a req-3587f2e9-8ae2-4adf-8fd2-71b4efc14a06 service nova] Acquired lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG nova.network.neutron [req-bef2fe0a-484b-4251-b1fe-26517d8baf4a req-3587f2e9-8ae2-4adf-8fd2-71b4efc14a06 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Refreshing network info cache for port 3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:05 user nova-compute[72447]: INFO nova.compute.manager [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Terminating instance
Jul 31 12:38:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-4d8ee0ab-0d14-4157-a8ed-f76ed7fb5650 req-2290453d-004a-444e-a8fc-b9eada2e832e service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Received event network-vif-unplugged-3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4d8ee0ab-0d14-4157-a8ed-f76ed7fb5650 req-2290453d-004a-444e-a8fc-b9eada2e832e service nova] Acquiring lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4d8ee0ab-0d14-4157-a8ed-f76ed7fb5650 req-2290453d-004a-444e-a8fc-b9eada2e832e service nova] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-4d8ee0ab-0d14-4157-a8ed-f76ed7fb5650 req-2290453d-004a-444e-a8fc-b9eada2e832e service nova] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-4d8ee0ab-0d14-4157-a8ed-f76ed7fb5650 req-2290453d-004a-444e-a8fc-b9eada2e832e service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] No waiting events found dispatching network-vif-unplugged-3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-4d8ee0ab-0d14-4157-a8ed-f76ed7fb5650 req-2290453d-004a-444e-a8fc-b9eada2e832e service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Received event network-vif-unplugged-3d8642ff-7536-43c2-b539-addb31e07e9c for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG nova.network.neutron [req-bef2fe0a-484b-4251-b1fe-26517d8baf4a req-3587f2e9-8ae2-4adf-8fd2-71b4efc14a06 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Updated VIF entry in instance network info cache for port 3d8642ff-7536-43c2-b539-addb31e07e9c. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG nova.network.neutron [req-bef2fe0a-484b-4251-b1fe-26517d8baf4a req-3587f2e9-8ae2-4adf-8fd2-71b4efc14a06 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Updating instance_info_cache with network_info: [{"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:38:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bef2fe0a-484b-4251-b1fe-26517d8baf4a req-3587f2e9-8ae2-4adf-8fd2-71b4efc14a06 service nova] Releasing lock "refresh_cache-d4bd5550-6cd3-4177-afbd-1e4981eeec99" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:38:06 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Instance destroyed successfully.
Jul 31 12:38:06 user nova-compute[72447]: DEBUG nova.objects.instance [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lazy-loading 'resources' on Instance uuid d4bd5550-6cd3-4177-afbd-1e4981eeec99 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:28:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-931000092',display_name='tempest-TestStampPattern-server-931000092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-931000092',id=38,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyqS6WM/VxoajJCxkzqFbYmyaWdRi6cEk7Qi4JAyZ2mMuFpcq2L/28ah02VGBE9ktZbXYHxyezmKduAO5nTjd+L4At4n2ckFxT9WdPLRl0ZpDmeip6oN8T4/B1+t44T7g==',key_name='tempest-TestStampPattern-2046413804',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:28:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20fef08187154b7da8fc1af9e8960a1b',ramdisk_id='',reservation_id='r-7l07gtog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1760569238',owner_user_name='tempest-TestStampPattern-1760569238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:31:51Z,user_data=None,user_id='55651d199ea94f2085d7f2950da100f9',uuid=d4bd5550-6cd3-4177-afbd-1e4981eeec99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Converting VIF {"id": "3d8642ff-7536-43c2-b539-addb31e07e9c", "address": "fa:16:3e:05:a4:49", "network": {"id": "8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91", "bridge": "br-int", "label": "tempest-TestStampPattern-1131765848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20fef08187154b7da8fc1af9e8960a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8642ff-75", "ovs_interfaceid": "3d8642ff-7536-43c2-b539-addb31e07e9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:a4:49,bridge_name='br-int',has_traffic_filtering=True,id=3d8642ff-7536-43c2-b539-addb31e07e9c,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8642ff-75') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG os_vif [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:a4:49,bridge_name='br-int',has_traffic_filtering=True,id=3d8642ff-7536-43c2-b539-addb31e07e9c,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8642ff-75') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d8642ff-75, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:38:06 user nova-compute[72447]: INFO os_vif [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:a4:49,bridge_name='br-int',has_traffic_filtering=True,id=3d8642ff-7536-43c2-b539-addb31e07e9c,network=Network(8bb4a456-5fc5-4ac5-9ba8-50aef31bdf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8642ff-75')
Jul 31 12:38:06 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Deleting instance files /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99_del
Jul 31 12:38:06 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Deletion of /opt/stack/data/nova/instances/d4bd5550-6cd3-4177-afbd-1e4981eeec99_del complete
Jul 31 12:38:06 user nova-compute[72447]: INFO nova.compute.manager [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 31 12:38:06 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:38:06 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Took 0.53 seconds to deallocate network for instance.
Jul 31 12:38:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:38:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:06 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Deleted allocations for instance d4bd5550-6cd3-4177-afbd-1e4981eeec99
Jul 31 12:38:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-be0e051a-c8c3-4124-8bba-560b23dbe0be tempest-TestStampPattern-1760569238 tempest-TestStampPattern-1760569238-project-member] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.881s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-710b0fad-fad6-493d-a1a2-3bd71d142047 req-b5b2a022-78f2-4dd8-87c3-8fbd79a3bdee service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Received event network-vif-deleted-3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:38:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-b4aa1baa-1380-4fcd-a89b-7f7e3ac94abc req-9fc388c5-f625-493d-8e7a-f3d99a436407 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Received event network-vif-plugged-3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:38:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b4aa1baa-1380-4fcd-a89b-7f7e3ac94abc req-9fc388c5-f625-493d-8e7a-f3d99a436407 service nova] Acquiring lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b4aa1baa-1380-4fcd-a89b-7f7e3ac94abc req-9fc388c5-f625-493d-8e7a-f3d99a436407 service nova] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b4aa1baa-1380-4fcd-a89b-7f7e3ac94abc req-9fc388c5-f625-493d-8e7a-f3d99a436407 service nova] Lock "d4bd5550-6cd3-4177-afbd-1e4981eeec99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:07 user nova-compute[72447]: DEBUG nova.compute.manager [req-b4aa1baa-1380-4fcd-a89b-7f7e3ac94abc req-9fc388c5-f625-493d-8e7a-f3d99a436407 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] No waiting events found dispatching network-vif-plugged-3d8642ff-7536-43c2-b539-addb31e07e9c {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:38:07 user nova-compute[72447]: WARNING nova.compute.manager [req-b4aa1baa-1380-4fcd-a89b-7f7e3ac94abc req-9fc388c5-f625-493d-8e7a-f3d99a436407 service nova] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Received unexpected event network-vif-plugged-3d8642ff-7536-43c2-b539-addb31e07e9c for instance with vm_state deleted and task_state None.
Jul 31 12:38:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:38:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:38:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-6707cbc8-a675-4248-b324-40630ebff478" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:38:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-6707cbc8-a675-4248-b324-40630ebff478" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:38:09 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:38:09 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Updating instance_info_cache with network_info: [{"id": "a880d610-9f14-4c6b-9326-35e1acfadce9", "address": "fa:16:3e:cb:dd:96", "network": {"id": "7a6b5ac7-4005-4a8b-9e99-f243de007ed1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1888569421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b255b73bddd844339eb858285c00db00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa880d610-9f", "ovs_interfaceid": "a880d610-9f14-4c6b-9326-35e1acfadce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:38:09 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-6707cbc8-a675-4248-b324-40630ebff478" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:38:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:38:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:38:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:38:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:38:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:38:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:38:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:16 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:38:16 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:38:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8583MB free_disk=25.15326690673828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:38:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:38:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 6707cbc8-a675-4248-b324-40630ebff478 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:38:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:38:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:38:16 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:38:16 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:38:16 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:38:16 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:38:20 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690807086.0117753, d4bd5550-6cd3-4177-afbd-1e4981eeec99 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:38:21 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] VM Stopped (Lifecycle Event)
Jul 31 12:38:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-6050a95d-27f1-404e-9de1-ee7d0d405de8 None None] [instance: d4bd5550-6cd3-4177-afbd-1e4981eeec99] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:38:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:38:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:38:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:38:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:38:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:38:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:38:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:38:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:38:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:32 user nova-compute[72447]: INFO nova.compute.manager [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Terminating instance
Jul 31 12:38:32 user nova-compute[72447]: DEBUG nova.compute.manager [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:38:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-2f358ad1-563a-4d0f-8547-59d3e18cb227 req-f4823a37-b22c-4e26-801f-9d9736035262 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Received event network-vif-unplugged-a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2f358ad1-563a-4d0f-8547-59d3e18cb227 req-f4823a37-b22c-4e26-801f-9d9736035262 service nova] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2f358ad1-563a-4d0f-8547-59d3e18cb227 req-f4823a37-b22c-4e26-801f-9d9736035262 service nova] Lock "6707cbc8-a675-4248-b324-40630ebff478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2f358ad1-563a-4d0f-8547-59d3e18cb227 req-f4823a37-b22c-4e26-801f-9d9736035262 service nova] Lock "6707cbc8-a675-4248-b324-40630ebff478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-2f358ad1-563a-4d0f-8547-59d3e18cb227 req-f4823a37-b22c-4e26-801f-9d9736035262 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] No waiting events found dispatching network-vif-unplugged-a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-2f358ad1-563a-4d0f-8547-59d3e18cb227 req-f4823a37-b22c-4e26-801f-9d9736035262 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Received event network-vif-unplugged-a880d610-9f14-4c6b-9326-35e1acfadce9 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:33 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Instance destroyed successfully.
Jul 31 12:38:33 user nova-compute[72447]: DEBUG nova.objects.instance [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lazy-loading 'resources' on Instance uuid 6707cbc8-a675-4248-b324-40630ebff478 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2070769532',display_name='tempest-SnapshotDataIntegrityTests-server-2070769532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2070769532',id=42,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINkbrkfJpKZmjBN9r7SLximw1BfoVx3NWjHFn4ZiQwKeftdltQse3DNF+Y8RlYrdgiDTQ6n+fIuW5wbU56Xh64d4x9KlDkb8VqcfweZZjJ1YhZZOrsOQjLCrbJS6DE2Jw==',key_name='tempest-keypair-509508350',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:31:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b255b73bddd844339eb858285c00db00',ramdisk_id='',reservation_id='r-199on6c8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-582576876',owner_user_name='tempest-SnapshotDataIntegrityTests-582576876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:31:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96e413ee6ade47fda14082abe8592c55',uuid=6707cbc8-a675-4248-b324-40630ebff478,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a880d610-9f14-4c6b-9326-35e1acfadce9", "address": "fa:16:3e:cb:dd:96", "network": {"id": "7a6b5ac7-4005-4a8b-9e99-f243de007ed1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1888569421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b255b73bddd844339eb858285c00db00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa880d610-9f", "ovs_interfaceid": "a880d610-9f14-4c6b-9326-35e1acfadce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Converting VIF {"id": "a880d610-9f14-4c6b-9326-35e1acfadce9", "address": "fa:16:3e:cb:dd:96", "network": {"id": "7a6b5ac7-4005-4a8b-9e99-f243de007ed1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1888569421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b255b73bddd844339eb858285c00db00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa880d610-9f", "ovs_interfaceid": "a880d610-9f14-4c6b-9326-35e1acfadce9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:dd:96,bridge_name='br-int',has_traffic_filtering=True,id=a880d610-9f14-4c6b-9326-35e1acfadce9,network=Network(7a6b5ac7-4005-4a8b-9e99-f243de007ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa880d610-9f') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG os_vif [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:dd:96,bridge_name='br-int',has_traffic_filtering=True,id=a880d610-9f14-4c6b-9326-35e1acfadce9,network=Network(7a6b5ac7-4005-4a8b-9e99-f243de007ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa880d610-9f') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa880d610-9f, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:38:33 user nova-compute[72447]: INFO os_vif [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:dd:96,bridge_name='br-int',has_traffic_filtering=True,id=a880d610-9f14-4c6b-9326-35e1acfadce9,network=Network(7a6b5ac7-4005-4a8b-9e99-f243de007ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa880d610-9f')
Jul 31 12:38:33 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Deleting instance files /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478_del
Jul 31 12:38:33 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Deletion of /opt/stack/data/nova/instances/6707cbc8-a675-4248-b324-40630ebff478_del complete
Jul 31 12:38:33 user nova-compute[72447]: INFO nova.compute.manager [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 31 12:38:33 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:38:33 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 6707cbc8-a675-4248-b324-40630ebff478] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:38:34 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:38:34 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Took 1.21 seconds to deallocate network for instance.
Jul 31 12:38:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-b13925f4-6548-47b5-8749-16d14a51c4c7 req-e6c6d947-4777-48da-bc3f-949f168f3e77 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Received event network-vif-deleted-a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:38:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:34 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:38:34 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:38:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:34 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Deleted allocations for instance 6707cbc8-a675-4248-b324-40630ebff478
Jul 31 12:38:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-20a92db4-96ed-4f3e-b677-fe9f6d4fd1d4 tempest-SnapshotDataIntegrityTests-582576876 tempest-SnapshotDataIntegrityTests-582576876-project-member] Lock "6707cbc8-a675-4248-b324-40630ebff478" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.456s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-bb8e27a4-39db-4d7e-a140-3768166e7987 req-20a2d2ef-9531-45b4-a20b-47f51f3f26c2 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Received event network-vif-plugged-a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:38:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bb8e27a4-39db-4d7e-a140-3768166e7987 req-20a2d2ef-9531-45b4-a20b-47f51f3f26c2 service nova] Acquiring lock "6707cbc8-a675-4248-b324-40630ebff478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bb8e27a4-39db-4d7e-a140-3768166e7987 req-20a2d2ef-9531-45b4-a20b-47f51f3f26c2 service nova] Lock "6707cbc8-a675-4248-b324-40630ebff478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-bb8e27a4-39db-4d7e-a140-3768166e7987 req-20a2d2ef-9531-45b4-a20b-47f51f3f26c2 service nova] Lock "6707cbc8-a675-4248-b324-40630ebff478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:35 user nova-compute[72447]: DEBUG nova.compute.manager [req-bb8e27a4-39db-4d7e-a140-3768166e7987 req-20a2d2ef-9531-45b4-a20b-47f51f3f26c2 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] No waiting events found dispatching network-vif-plugged-a880d610-9f14-4c6b-9326-35e1acfadce9 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:38:35 user nova-compute[72447]: WARNING nova.compute.manager [req-bb8e27a4-39db-4d7e-a140-3768166e7987 req-20a2d2ef-9531-45b4-a20b-47f51f3f26c2 service nova] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Received unexpected event network-vif-plugged-a880d610-9f14-4c6b-9326-35e1acfadce9 for instance with vm_state deleted and task_state None.
Jul 31 12:38:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:36 user nova-compute[72447]: INFO nova.compute.manager [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Terminating instance
Jul 31 12:38:36 user nova-compute[72447]: DEBUG nova.compute.manager [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-6aa85e7a-6226-4048-a8c2-225680cd17ba req-cad007f0-bf9e-4018-bdd9-7e7671abcdec service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-unplugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6aa85e7a-6226-4048-a8c2-225680cd17ba req-cad007f0-bf9e-4018-bdd9-7e7671abcdec service nova] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6aa85e7a-6226-4048-a8c2-225680cd17ba req-cad007f0-bf9e-4018-bdd9-7e7671abcdec service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6aa85e7a-6226-4048-a8c2-225680cd17ba req-cad007f0-bf9e-4018-bdd9-7e7671abcdec service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-6aa85e7a-6226-4048-a8c2-225680cd17ba req-cad007f0-bf9e-4018-bdd9-7e7671abcdec service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] No waiting events found dispatching network-vif-unplugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:38:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-6aa85e7a-6226-4048-a8c2-225680cd17ba req-cad007f0-bf9e-4018-bdd9-7e7671abcdec service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-unplugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:38:37 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Instance destroyed successfully.
Jul 31 12:38:37 user nova-compute[72447]: DEBUG nova.objects.instance [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'resources' on Instance uuid 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:38:37 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:28:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-675334656',display_name='tempest-AttachVolumeTestJSON-server-675334656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-675334656',id=39,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjaiwoFel2Eh2TCakrkW9agvz+yoDwe/zWXpzkLHB0ZWZVJFVho0opNQvvQrNB2zUmhAKykfMwu2NDRbQKV/RDfX39Ice4f0JVuhVt96pRXbOIBk6k5FqAJVOMHKQRawg==',key_name='tempest-keypair-1537936122',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f7c1764cced4b49ad8e55759362a8db',ramdisk_id='',reservation_id='r-p6axrgt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-182433734',owner_user_name='tempest-AttachVolumeTestJSON-182433734-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33486507bb4141d1a1753054199bce56',uuid=43b9c1c3-280c-4c26-9435-e50d29b3d8d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:38:37 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converting VIF {"id": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "address": "fa:16:3e:0c:31:61", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23148cca-e5", "ovs_interfaceid": "23148cca-e577-4eaa-ab83-b87a4d7dd713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:38:37 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:38:37 user nova-compute[72447]: DEBUG os_vif [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:38:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23148cca-e5, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:38:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:38:37 user nova-compute[72447]: INFO os_vif [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:31:61,bridge_name='br-int',has_traffic_filtering=True,id=23148cca-e577-4eaa-ab83-b87a4d7dd713,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23148cca-e5')
Jul 31 12:38:37 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Deleting instance files /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6_del
Jul 31 12:38:37 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Deletion of /opt/stack/data/nova/instances/43b9c1c3-280c-4c26-9435-e50d29b3d8d6_del complete
Jul 31 12:38:37 user nova-compute[72447]: INFO nova.compute.manager [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 31 12:38:37 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:38:37 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:38:37 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:38:38 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:38:38 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Took 1.12 seconds to deallocate network for instance.
Jul 31 12:38:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:38 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:38:38 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:38:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:38 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Deleted allocations for instance 43b9c1c3-280c-4c26-9435-e50d29b3d8d6
Jul 31 12:38:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-2c651c06-c828-4c27-8b64-7fad3bd45ae5 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.284s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-7b3f7d15-1a0b-4ada-9e50-5d98841c755b req-18c72a1a-1a36-4e55-8d4c-616082f2166f service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:38:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7b3f7d15-1a0b-4ada-9e50-5d98841c755b req-18c72a1a-1a36-4e55-8d4c-616082f2166f service nova] Acquiring lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:38:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7b3f7d15-1a0b-4ada-9e50-5d98841c755b req-18c72a1a-1a36-4e55-8d4c-616082f2166f service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:38:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7b3f7d15-1a0b-4ada-9e50-5d98841c755b req-18c72a1a-1a36-4e55-8d4c-616082f2166f service nova] Lock "43b9c1c3-280c-4c26-9435-e50d29b3d8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:38:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-7b3f7d15-1a0b-4ada-9e50-5d98841c755b req-18c72a1a-1a36-4e55-8d4c-616082f2166f service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] No waiting events found dispatching network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:38:38 user nova-compute[72447]: WARNING nova.compute.manager [req-7b3f7d15-1a0b-4ada-9e50-5d98841c755b req-18c72a1a-1a36-4e55-8d4c-616082f2166f service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received unexpected event network-vif-plugged-23148cca-e577-4eaa-ab83-b87a4d7dd713 for instance with vm_state deleted and task_state None.
Jul 31 12:38:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-7b3f7d15-1a0b-4ada-9e50-5d98841c755b req-18c72a1a-1a36-4e55-8d4c-616082f2166f service nova] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Received event network-vif-deleted-23148cca-e577-4eaa-ab83-b87a4d7dd713 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:38:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:48 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690807113.3289983, 6707cbc8-a675-4248-b324-40630ebff478 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:38:48 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 6707cbc8-a675-4248-b324-40630ebff478] VM Stopped (Lifecycle Event)
Jul 31 12:38:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-721b70b0-a8d0-4fb0-b8c6-4bebc250fb3a None None] [instance: 6707cbc8-a675-4248-b324-40630ebff478] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:38:52 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690807117.2508764, 43b9c1c3-280c-4c26-9435-e50d29b3d8d6 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:38:52 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] VM Stopped (Lifecycle Event)
Jul 31 12:38:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-79ed51f5-f337-4644-bfc8-bd7b89dd5ce9 None None] [instance: 43b9c1c3-280c-4c26-9435-e50d29b3d8d6] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:38:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:38:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:39:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:39:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:39:09 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:39:11 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:39:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:39:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:39:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:39:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:39:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:39:17 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:39:17 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:39:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=25.196826934814453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:39:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:39:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:39:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:39:31 user nova-compute[72447]: INFO nova.compute.claims [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Claim successful on node user
Jul 31 12:39:31 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:39:31 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:39:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG nova.policy [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33486507bb4141d1a1753054199bce56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7c1764cced4b49ad8e55759362a8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:39:31 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Creating image(s)
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "/opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "/opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "/opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.168s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "de2f30067631a9a63bc4a295415d89adb1b4831c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.162s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk 1073741824 {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c,backing_fmt=raw /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk 1073741824" returned: 0 in 0.057s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "de2f30067631a9a63bc4a295415d89adb1b4831c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c --force-share --output=json" returned: 0 in 0.183s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk. size=1073741824 {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG nova.virt.disk.api [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Cannot resize image /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk to a smaller size. {{(pid=72447) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG nova.objects.instance [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'migration_context' on Instance uuid 3086d9d8-ecd0-404a-9623-c2f21c194820 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Created local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Ensure instance console log exists: /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:32 user nova-compute[72447]: DEBUG nova.network.neutron [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Successfully created port: 7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:39:33 user nova-compute[72447]: DEBUG nova.network.neutron [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Successfully updated port: 7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:39:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-ac58fc95-2300-4166-94da-9aa04da87b7b req-0b64b795-e0bb-4f24-808e-298204166b59 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Received event network-changed-7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:39:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-ac58fc95-2300-4166-94da-9aa04da87b7b req-0b64b795-e0bb-4f24-808e-298204166b59 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Refreshing instance network info cache due to event network-changed-7ac7766a-5be3-444f-a253-dfc3c891ba11. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:39:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ac58fc95-2300-4166-94da-9aa04da87b7b req-0b64b795-e0bb-4f24-808e-298204166b59 service nova] Acquiring lock "refresh_cache-3086d9d8-ecd0-404a-9623-c2f21c194820" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:39:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ac58fc95-2300-4166-94da-9aa04da87b7b req-0b64b795-e0bb-4f24-808e-298204166b59 service nova] Acquired lock "refresh_cache-3086d9d8-ecd0-404a-9623-c2f21c194820" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:39:33 user nova-compute[72447]: DEBUG nova.network.neutron [req-ac58fc95-2300-4166-94da-9aa04da87b7b req-0b64b795-e0bb-4f24-808e-298204166b59 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Refreshing network info cache for port 7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:39:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "refresh_cache-3086d9d8-ecd0-404a-9623-c2f21c194820" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.network.neutron [req-ac58fc95-2300-4166-94da-9aa04da87b7b req-0b64b795-e0bb-4f24-808e-298204166b59 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.network.neutron [req-ac58fc95-2300-4166-94da-9aa04da87b7b req-0b64b795-e0bb-4f24-808e-298204166b59 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ac58fc95-2300-4166-94da-9aa04da87b7b req-0b64b795-e0bb-4f24-808e-298204166b59 service nova] Releasing lock "refresh_cache-3086d9d8-ecd0-404a-9623-c2f21c194820" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquired lock "refresh_cache-3086d9d8-ecd0-404a-9623-c2f21c194820" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.network.neutron [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.network.neutron [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.network.neutron [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Updating instance_info_cache with network_info: [{"id": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "address": "fa:16:3e:f7:c5:13", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac7766a-5b", "ovs_interfaceid": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Releasing lock "refresh_cache-3086d9d8-ecd0-404a-9623-c2f21c194820" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Instance network_info: |[{"id": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "address": "fa:16:3e:f7:c5:13", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac7766a-5b", "ovs_interfaceid": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Start _get_guest_xml network_info=[{"id": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "address": "fa:16:3e:f7:c5:13", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac7766a-5b", "ovs_interfaceid": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e1118021-a8cd-4e2b-b5b6-62d0c4085b6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:39:34 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:39:34 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T12:07:08Z,direct_url=<?>,disk_format='qcow2',id=e1118021-a8cd-4e2b-b5b6-62d0c4085b6e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b939df8aa3284b29bb9a09babf15f826',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T12:07:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1130701348',display_name='tempest-AttachVolumeTestJSON-server-1130701348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1130701348',id=44,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9iBh1Ovg7zhbmo2n5JxC5Wy+eFHfcV4V65+a7owIOmYGleLpsnH1N8XG4j8yWTz+agd/CCnT/V7UcPNBMptR6EK52v4ryCuCSXkt5087yfr4gGA57uOHgZxdB+gkp5yg==',key_name='tempest-keypair-1536022868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f7c1764cced4b49ad8e55759362a8db',ramdisk_id='',reservation_id='r-owob4u4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-182433734',owner_user_name='tempest-AttachVolumeTestJSON-182433734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33486507bb4141d1a1753054199bce56',uuid=3086d9d8-ecd0-404a-9623-c2f21c194820,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "address": "fa:16:3e:f7:c5:13", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac7766a-5b", "ovs_interfaceid": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converting VIF {"id": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "address": "fa:16:3e:f7:c5:13", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac7766a-5b", "ovs_interfaceid": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=7ac7766a-5be3-444f-a253-dfc3c891ba11,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac7766a-5b') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.objects.instance [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'pci_devices' on Instance uuid 3086d9d8-ecd0-404a-9623-c2f21c194820 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:39:34 user nova-compute[72447]:   <uuid>3086d9d8-ecd0-404a-9623-c2f21c194820</uuid>
Jul 31 12:39:34 user nova-compute[72447]:   <name>instance-0000002c</name>
Jul 31 12:39:34 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:39:34 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:39:34 user nova-compute[72447]:   <metadata>
Jul 31 12:39:34 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:39:34 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:39:34 user nova-compute[72447]:       <nova:name>tempest-AttachVolumeTestJSON-server-1130701348</nova:name>
Jul 31 12:39:34 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:39:34</nova:creationTime>
Jul 31 12:39:34 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:39:34 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:39:34 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:39:34 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:39:34 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:39:34 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:39:34 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:39:34 user nova-compute[72447]:       <nova:owner>
Jul 31 12:39:34 user nova-compute[72447]:         <nova:user uuid="33486507bb4141d1a1753054199bce56">tempest-AttachVolumeTestJSON-182433734-project-member</nova:user>
Jul 31 12:39:34 user nova-compute[72447]:         <nova:project uuid="6f7c1764cced4b49ad8e55759362a8db">tempest-AttachVolumeTestJSON-182433734</nova:project>
Jul 31 12:39:34 user nova-compute[72447]:       </nova:owner>
Jul 31 12:39:34 user nova-compute[72447]:       <nova:root type="image" uuid="e1118021-a8cd-4e2b-b5b6-62d0c4085b6e"/>
Jul 31 12:39:34 user nova-compute[72447]:       <nova:ports>
Jul 31 12:39:34 user nova-compute[72447]:         <nova:port uuid="7ac7766a-5be3-444f-a253-dfc3c891ba11">
Jul 31 12:39:34 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 12:39:34 user nova-compute[72447]:         </nova:port>
Jul 31 12:39:34 user nova-compute[72447]:       </nova:ports>
Jul 31 12:39:34 user nova-compute[72447]:     </nova:instance>
Jul 31 12:39:34 user nova-compute[72447]:   </metadata>
Jul 31 12:39:34 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:39:34 user nova-compute[72447]:     <system>
Jul 31 12:39:34 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:39:34 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:39:34 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:39:34 user nova-compute[72447]:       <entry name="serial">3086d9d8-ecd0-404a-9623-c2f21c194820</entry>
Jul 31 12:39:34 user nova-compute[72447]:       <entry name="uuid">3086d9d8-ecd0-404a-9623-c2f21c194820</entry>
Jul 31 12:39:34 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:39:34 user nova-compute[72447]:     </system>
Jul 31 12:39:34 user nova-compute[72447]:   </sysinfo>
Jul 31 12:39:34 user nova-compute[72447]:   <os>
Jul 31 12:39:34 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:39:34 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:39:34 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:39:34 user nova-compute[72447]:   </os>
Jul 31 12:39:34 user nova-compute[72447]:   <features>
Jul 31 12:39:34 user nova-compute[72447]:     <acpi/>
Jul 31 12:39:34 user nova-compute[72447]:     <apic/>
Jul 31 12:39:34 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:39:34 user nova-compute[72447]:   </features>
Jul 31 12:39:34 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:39:34 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:39:34 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:39:34 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:39:34 user nova-compute[72447]:   </clock>
Jul 31 12:39:34 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:39:34 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:39:34 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:39:34 user nova-compute[72447]:   </cpu>
Jul 31 12:39:34 user nova-compute[72447]:   <devices>
Jul 31 12:39:34 user nova-compute[72447]:     <disk type="file" device="disk">
Jul 31 12:39:34 user nova-compute[72447]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 12:39:34 user nova-compute[72447]:       <source file="/opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk"/>
Jul 31 12:39:34 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:39:34 user nova-compute[72447]:     </disk>
Jul 31 12:39:34 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:39:34 user nova-compute[72447]:       <mac address="fa:16:3e:f7:c5:13"/>
Jul 31 12:39:34 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:39:34 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:39:34 user nova-compute[72447]:       <target dev="tap7ac7766a-5b"/>
Jul 31 12:39:34 user nova-compute[72447]:     </interface>
Jul 31 12:39:34 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:39:34 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/console.log" append="off"/>
Jul 31 12:39:34 user nova-compute[72447]:     </serial>
Jul 31 12:39:34 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:39:34 user nova-compute[72447]:     <video>
Jul 31 12:39:34 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:39:34 user nova-compute[72447]:     </video>
Jul 31 12:39:34 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:39:34 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:39:34 user nova-compute[72447]:     </rng>
Jul 31 12:39:34 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:39:34 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:39:34 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:39:34 user nova-compute[72447]:     </memballoon>
Jul 31 12:39:34 user nova-compute[72447]:   </devices>
Jul 31 12:39:34 user nova-compute[72447]: </domain>
Jul 31 12:39:34 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1130701348',display_name='tempest-AttachVolumeTestJSON-server-1130701348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1130701348',id=44,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9iBh1Ovg7zhbmo2n5JxC5Wy+eFHfcV4V65+a7owIOmYGleLpsnH1N8XG4j8yWTz+agd/CCnT/V7UcPNBMptR6EK52v4ryCuCSXkt5087yfr4gGA57uOHgZxdB+gkp5yg==',key_name='tempest-keypair-1536022868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f7c1764cced4b49ad8e55759362a8db',ramdisk_id='',reservation_id='r-owob4u4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-182433734',owner_user_name='tempest-AttachVolumeTestJSON-182433734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33486507bb4141d1a1753054199bce56',uuid=3086d9d8-ecd0-404a-9623-c2f21c194820,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "address": "fa:16:3e:f7:c5:13", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac7766a-5b", "ovs_interfaceid": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converting VIF {"id": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "address": "fa:16:3e:f7:c5:13", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac7766a-5b", "ovs_interfaceid": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=7ac7766a-5be3-444f-a253-dfc3c891ba11,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac7766a-5b') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG os_vif [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=7ac7766a-5be3-444f-a253-dfc3c891ba11,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac7766a-5b') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ac7766a-5b, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ac7766a-5b, col_values=(('external_ids', {'iface-id': '7ac7766a-5be3-444f-a253-dfc3c891ba11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:c5:13', 'vm-uuid': '3086d9d8-ecd0-404a-9623-c2f21c194820'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:34 user nova-compute[72447]: INFO os_vif [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=7ac7766a-5be3-444f-a253-dfc3c891ba11,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac7766a-5b')
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:39:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No VIF found with MAC fa:16:3e:f7:c5:13, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:39:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-9fe57c4c-a7e4-48a9-8e62-81ea49329f1c req-13f3bc46-ef97-4193-b57b-c40619ad1ded service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Received event network-vif-plugged-7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9fe57c4c-a7e4-48a9-8e62-81ea49329f1c req-13f3bc46-ef97-4193-b57b-c40619ad1ded service nova] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9fe57c4c-a7e4-48a9-8e62-81ea49329f1c req-13f3bc46-ef97-4193-b57b-c40619ad1ded service nova] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9fe57c4c-a7e4-48a9-8e62-81ea49329f1c req-13f3bc46-ef97-4193-b57b-c40619ad1ded service nova] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-9fe57c4c-a7e4-48a9-8e62-81ea49329f1c req-13f3bc46-ef97-4193-b57b-c40619ad1ded service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] No waiting events found dispatching network-vif-plugged-7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:39:36 user nova-compute[72447]: WARNING nova.compute.manager [req-9fe57c4c-a7e4-48a9-8e62-81ea49329f1c req-13f3bc46-ef97-4193-b57b-c40619ad1ded service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Received unexpected event network-vif-plugged-7ac7766a-5be3-444f-a253-dfc3c891ba11 for instance with vm_state building and task_state spawning.
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:39:36 user nova-compute[72447]: INFO nova.compute.claims [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Claim successful on node user
Jul 31 12:39:36 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:36 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:39:36 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:39:36 user nova-compute[72447]: INFO nova.virt.block_device [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Booting with volume 42560baf-28a9-41c7-8308-2df68f8f8ba7 at /dev/vda
Jul 31 12:39:36 user nova-compute[72447]: DEBUG nova.policy [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41a7e247ef274dc9b1fc3fd75a6005f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce85700824de42378524bbe3b028cc43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG os_brick.utils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b0911-c4db-48b6-9130-adcb1ec25924]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bb6c22-a7f3-4127-a238-0b98e479b527]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cca0ac0-d00c-49c5-8755-0a76ec986502]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a5e356-ee9f-4404-b82b-cf1194d60980]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:36 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:39:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:39:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:39:37 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:39:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[215a8cdf-3bf7-4cdf-814d-6fe1a4aebbd7]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:39:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:39:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:39:37 user nova-compute[72447]: DEBUG os_brick.utils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:39:37 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating existing volume attachment record: 9812b839-876b-44c8-ad8e-4539b8b8ae1a {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:39:37 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Successfully created port: 7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807178.3035343, 3086d9d8-ecd0-404a-9623-c2f21c194820 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:39:38 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] VM Resumed (Lifecycle Event)
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:39:38 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Instance spawned successfully.
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-c333a7db-75d5-47fe-b2d4-d0f4523dbaae req-97dcda4a-760b-4119-96e3-d2a425d5b606 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Received event network-vif-plugged-7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c333a7db-75d5-47fe-b2d4-d0f4523dbaae req-97dcda4a-760b-4119-96e3-d2a425d5b606 service nova] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c333a7db-75d5-47fe-b2d4-d0f4523dbaae req-97dcda4a-760b-4119-96e3-d2a425d5b606 service nova] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c333a7db-75d5-47fe-b2d4-d0f4523dbaae req-97dcda4a-760b-4119-96e3-d2a425d5b606 service nova] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.compute.manager [req-c333a7db-75d5-47fe-b2d4-d0f4523dbaae req-97dcda4a-760b-4119-96e3-d2a425d5b606 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] No waiting events found dispatching network-vif-plugged-7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:39:38 user nova-compute[72447]: WARNING nova.compute.manager [req-c333a7db-75d5-47fe-b2d4-d0f4523dbaae req-97dcda4a-760b-4119-96e3-d2a425d5b606 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Received unexpected event network-vif-plugged-7ac7766a-5be3-444f-a253-dfc3c891ba11 for instance with vm_state building and task_state spawning.
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:39:38 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807178.3040147, 3086d9d8-ecd0-404a-9623-c2f21c194820 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:39:38 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] VM Started (Lifecycle Event)
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Successfully updated port: 7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:39:38 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:39:38 user nova-compute[72447]: INFO nova.compute.manager [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Took 6.69 seconds to spawn the instance on the hypervisor.
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquired lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:39:38 user nova-compute[72447]: INFO nova.compute.manager [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Took 7.28 seconds to build instance.
Jul 31 12:39:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-37d35275-abcb-468e-b391-043783282e17 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.395s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.network.neutron [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating instance_info_cache with network_info: [{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Releasing lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:39:38 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Instance network_info: |[{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:39:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:40 user nova-compute[72447]: DEBUG nova.compute.manager [req-a5474af0-6adc-4548-90cd-25721ef39b0d req-bcc6b711-e675-42e9-b536-8048165ac90a service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-changed-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:39:40 user nova-compute[72447]: DEBUG nova.compute.manager [req-a5474af0-6adc-4548-90cd-25721ef39b0d req-bcc6b711-e675-42e9-b536-8048165ac90a service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Refreshing instance network info cache due to event network-changed-7c71e1bc-cb13-4391-aae1-93f292af5eaa. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:39:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a5474af0-6adc-4548-90cd-25721ef39b0d req-bcc6b711-e675-42e9-b536-8048165ac90a service nova] Acquiring lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:39:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a5474af0-6adc-4548-90cd-25721ef39b0d req-bcc6b711-e675-42e9-b536-8048165ac90a service nova] Acquired lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:39:40 user nova-compute[72447]: DEBUG nova.network.neutron [req-a5474af0-6adc-4548-90cd-25721ef39b0d req-bcc6b711-e675-42e9-b536-8048165ac90a service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Refreshing network info cache for port 7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:39:41 user nova-compute[72447]: DEBUG nova.network.neutron [req-a5474af0-6adc-4548-90cd-25721ef39b0d req-bcc6b711-e675-42e9-b536-8048165ac90a service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updated VIF entry in instance network info cache for port 7c71e1bc-cb13-4391-aae1-93f292af5eaa. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:39:41 user nova-compute[72447]: DEBUG nova.network.neutron [req-a5474af0-6adc-4548-90cd-25721ef39b0d req-bcc6b711-e675-42e9-b536-8048165ac90a service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating instance_info_cache with network_info: [{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:39:41 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a5474af0-6adc-4548-90cd-25721ef39b0d req-bcc6b711-e675-42e9-b536-8048165ac90a service nova] Releasing lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:39:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Creating image(s)
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Ensure instance console log exists: /opt/stack/data/nova/instances/61fd2bb6-953a-4803-81bd-d1f03c1bc8a4/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Start _get_guest_xml network_info=[{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '9812b839-876b-44c8-ad8e-4539b8b8ae1a', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsUmHgXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '61fd2bb6-953a-4803-81bd-d1f03c1bc8a4', 'attached_at': '', 'detached_at': '', 'volume_id': '42560baf-28a9-41c7-8308-2df68f8f8ba7', 'serial': '42560baf-28a9-41c7-8308-2df68f8f8ba7'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:39:44 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:39:44 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsUmHgXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:39:44 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:39:44 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:39:44 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[db429c49-06e7-46b1-a5b5-8d4799a6e180]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:39:44 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8bb8fc-5416-4d96-9f46-06690b26457d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7] added
Jul 31 12:39:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc42a58-5266-4938-be02-1e4041276017]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec470ab-10fb-4f7c-989e-3f47bab84470]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xsUmHgXu {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xsUmHgXu" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b668da-2c66-4899-ba5b-e88655f5b108]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xsUmHgXu'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4139b1-a870-4c87-9fd6-f3dcde893f93]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d86fa6f-d4bc-4840-949f-90b80b43449e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:39:44 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:39:44 user nova-compute[72447]:  {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:39:44 user nova-compute[72447]: WARNING os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 12:39:44 user nova-compute[72447]: 
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28c06ec-c8ef-44cd-8ac7-2e756772b85c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260]
Jul 31 12:39:44 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260] successful.
Jul 31 12:39:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d726bc-7819-4c36-b7fa-55b2162e05c5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f86d22d-2c64-42a4-bd78-572c40d18999]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 (non-flash)
Jul 31 12:39:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 (non-flash)
Jul 31 12:39:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8ef065-a7ca-4597-82df-0d5276d2e222]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsUmHgXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:39:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26161646264646161', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161646264646161', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1864140187',display_name='tempest-TestShelveInstance-server-1864140187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1864140187',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ03gNLjoCPcs12yPAxccibhYxpPl/qrIlTnezq1CyDr0QNdT8G9WzvloMs7cHUg5kcQo6A89NB7m7vFODXRWKlJx0C7YVLnbkSxoTCTyfDIKAzvMZ8k8xuAIpNAGybmw==',key_name='tempest-TestShelveInstance-1517846330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce85700824de42378524bbe3b028cc43',ramdisk_id='',reservation_id='r-fygzdt90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-158902571',owner_user_name='tempest-TestShelveInstance-158902571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:39:37Z,user_data=None,user_id='41a7e247ef274dc9b1fc3fd75a6005f1',uuid=61fd2bb6-953a-4803-81bd-d1f03c1bc8a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Converting VIF {"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG nova.objects.instance [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lazy-loading 'pci_devices' on Instance uuid 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:39:45 user nova-compute[72447]:   <uuid>61fd2bb6-953a-4803-81bd-d1f03c1bc8a4</uuid>
Jul 31 12:39:45 user nova-compute[72447]:   <name>instance-0000002d</name>
Jul 31 12:39:45 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:39:45 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:39:45 user nova-compute[72447]:   <metadata>
Jul 31 12:39:45 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:39:45 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:39:45 user nova-compute[72447]:       <nova:name>tempest-TestShelveInstance-server-1864140187</nova:name>
Jul 31 12:39:45 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:39:44</nova:creationTime>
Jul 31 12:39:45 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:39:45 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:39:45 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:39:45 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:39:45 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:39:45 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:39:45 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:39:45 user nova-compute[72447]:       <nova:owner>
Jul 31 12:39:45 user nova-compute[72447]:         <nova:user uuid="41a7e247ef274dc9b1fc3fd75a6005f1">tempest-TestShelveInstance-158902571-project-member</nova:user>
Jul 31 12:39:45 user nova-compute[72447]:         <nova:project uuid="ce85700824de42378524bbe3b028cc43">tempest-TestShelveInstance-158902571</nova:project>
Jul 31 12:39:45 user nova-compute[72447]:       </nova:owner>
Jul 31 12:39:45 user nova-compute[72447]:       <nova:ports>
Jul 31 12:39:45 user nova-compute[72447]:         <nova:port uuid="7c71e1bc-cb13-4391-aae1-93f292af5eaa">
Jul 31 12:39:45 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:39:45 user nova-compute[72447]:         </nova:port>
Jul 31 12:39:45 user nova-compute[72447]:       </nova:ports>
Jul 31 12:39:45 user nova-compute[72447]:     </nova:instance>
Jul 31 12:39:45 user nova-compute[72447]:   </metadata>
Jul 31 12:39:45 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:39:45 user nova-compute[72447]:     <system>
Jul 31 12:39:45 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:39:45 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:39:45 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:39:45 user nova-compute[72447]:       <entry name="serial">61fd2bb6-953a-4803-81bd-d1f03c1bc8a4</entry>
Jul 31 12:39:45 user nova-compute[72447]:       <entry name="uuid">61fd2bb6-953a-4803-81bd-d1f03c1bc8a4</entry>
Jul 31 12:39:45 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:39:45 user nova-compute[72447]:     </system>
Jul 31 12:39:45 user nova-compute[72447]:   </sysinfo>
Jul 31 12:39:45 user nova-compute[72447]:   <os>
Jul 31 12:39:45 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:39:45 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:39:45 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:39:45 user nova-compute[72447]:   </os>
Jul 31 12:39:45 user nova-compute[72447]:   <features>
Jul 31 12:39:45 user nova-compute[72447]:     <acpi/>
Jul 31 12:39:45 user nova-compute[72447]:     <apic/>
Jul 31 12:39:45 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:39:45 user nova-compute[72447]:   </features>
Jul 31 12:39:45 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:39:45 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:39:45 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:39:45 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:39:45 user nova-compute[72447]:   </clock>
Jul 31 12:39:45 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:39:45 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:39:45 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:39:45 user nova-compute[72447]:   </cpu>
Jul 31 12:39:45 user nova-compute[72447]:   <devices>
Jul 31 12:39:45 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:39:45 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:39:45 user nova-compute[72447]:       <source dev="/dev/sdb"/>
Jul 31 12:39:45 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:39:45 user nova-compute[72447]:       <serial>42560baf-28a9-41c7-8308-2df68f8f8ba7</serial>
Jul 31 12:39:45 user nova-compute[72447]:     </disk>
Jul 31 12:39:45 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:39:45 user nova-compute[72447]:       <mac address="fa:16:3e:41:db:7f"/>
Jul 31 12:39:45 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:39:45 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:39:45 user nova-compute[72447]:       <target dev="tap7c71e1bc-cb"/>
Jul 31 12:39:45 user nova-compute[72447]:     </interface>
Jul 31 12:39:45 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:39:45 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/61fd2bb6-953a-4803-81bd-d1f03c1bc8a4/console.log" append="off"/>
Jul 31 12:39:45 user nova-compute[72447]:     </serial>
Jul 31 12:39:45 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:39:45 user nova-compute[72447]:     <video>
Jul 31 12:39:45 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:39:45 user nova-compute[72447]:     </video>
Jul 31 12:39:45 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:39:45 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:39:45 user nova-compute[72447]:     </rng>
Jul 31 12:39:45 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:39:45 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:39:45 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:39:45 user nova-compute[72447]:     </memballoon>
Jul 31 12:39:45 user nova-compute[72447]:   </devices>
Jul 31 12:39:45 user nova-compute[72447]: </domain>
Jul 31 12:39:45 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1864140187',display_name='tempest-TestShelveInstance-server-1864140187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1864140187',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ03gNLjoCPcs12yPAxccibhYxpPl/qrIlTnezq1CyDr0QNdT8G9WzvloMs7cHUg5kcQo6A89NB7m7vFODXRWKlJx0C7YVLnbkSxoTCTyfDIKAzvMZ8k8xuAIpNAGybmw==',key_name='tempest-TestShelveInstance-1517846330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce85700824de42378524bbe3b028cc43',ramdisk_id='',reservation_id='r-fygzdt90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-158902571',owner_user_name='tempest-TestShelveInstance-158902571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:39:37Z,user_data=None,user_id='41a7e247ef274dc9b1fc3fd75a6005f1',uuid=61fd2bb6-953a-4803-81bd-d1f03c1bc8a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Converting VIF {"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG os_vif [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c71e1bc-cb, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c71e1bc-cb, col_values=(('external_ids', {'iface-id': '7c71e1bc-cb13-4391-aae1-93f292af5eaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:db:7f', 'vm-uuid': '61fd2bb6-953a-4803-81bd-d1f03c1bc8a4'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:45 user nova-compute[72447]: INFO os_vif [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb')
Jul 31 12:39:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:39:45 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] No VIF found with MAC fa:16:3e:41:db:7f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:39:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-71715d42-0199-458b-94db-62997b233c90 req-13423edf-feb6-4205-8d5f-dd50cd0beab7 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:39:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-71715d42-0199-458b-94db-62997b233c90 req-13423edf-feb6-4205-8d5f-dd50cd0beab7 service nova] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-71715d42-0199-458b-94db-62997b233c90 req-13423edf-feb6-4205-8d5f-dd50cd0beab7 service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-71715d42-0199-458b-94db-62997b233c90 req-13423edf-feb6-4205-8d5f-dd50cd0beab7 service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-71715d42-0199-458b-94db-62997b233c90 req-13423edf-feb6-4205-8d5f-dd50cd0beab7 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] No waiting events found dispatching network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:39:47 user nova-compute[72447]: WARNING nova.compute.manager [req-71715d42-0199-458b-94db-62997b233c90 req-13423edf-feb6-4205-8d5f-dd50cd0beab7 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received unexpected event network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa for instance with vm_state building and task_state spawning.
Jul 31 12:39:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807189.0805027, 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:39:49 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] VM Resumed (Lifecycle Event)
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:39:49 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Instance spawned successfully.
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:39:49 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807189.0836906, 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:39:49 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] VM Started (Lifecycle Event)
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:39:49 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:39:49 user nova-compute[72447]: INFO nova.compute.manager [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Took 4.87 seconds to spawn the instance on the hypervisor.
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:39:49 user nova-compute[72447]: INFO nova.compute.manager [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Took 12.90 seconds to build instance.
Jul 31 12:39:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-1b3fe53b-f123-4717-99d0-13bc32354c23 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.033s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-80373b2d-ade0-4b53-b255-df85ed3ace8e req-541c2c95-e364-4aaa-967a-d285a39e9f2b service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80373b2d-ade0-4b53-b255-df85ed3ace8e req-541c2c95-e364-4aaa-967a-d285a39e9f2b service nova] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80373b2d-ade0-4b53-b255-df85ed3ace8e req-541c2c95-e364-4aaa-967a-d285a39e9f2b service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-80373b2d-ade0-4b53-b255-df85ed3ace8e req-541c2c95-e364-4aaa-967a-d285a39e9f2b service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:39:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-80373b2d-ade0-4b53-b255-df85ed3ace8e req-541c2c95-e364-4aaa-967a-d285a39e9f2b service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] No waiting events found dispatching network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:39:49 user nova-compute[72447]: WARNING nova.compute.manager [req-80373b2d-ade0-4b53-b255-df85ed3ace8e req-541c2c95-e364-4aaa-967a-d285a39e9f2b service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received unexpected event network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa for instance with vm_state active and task_state None.
Jul 31 12:39:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:39:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:09 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:40:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:11 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:40:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:40:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:40:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-3086d9d8-ecd0-404a-9623-c2f21c194820" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:40:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-3086d9d8-ecd0-404a-9623-c2f21c194820" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:40:11 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:40:11 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid 3086d9d8-ecd0-404a-9623-c2f21c194820 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:40:12 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Updating instance_info_cache with network_info: [{"id": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "address": "fa:16:3e:f7:c5:13", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac7766a-5b", "ovs_interfaceid": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:40:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-3086d9d8-ecd0-404a-9623-c2f21c194820" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:40:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:40:12 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:40:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:40:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:40:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:40:18 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:40:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:40:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:40:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:40:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:40:19 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:40:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:40:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:40:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:40:19 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:40:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:40:20 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:40:20 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:40:20 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8543MB free_disk=25.156139373779297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:40:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:40:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:40:20 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 3086d9d8-ecd0-404a-9623-c2f21c194820 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:40:20 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:40:20 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:40:20 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:40:20 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:40:20 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:40:20 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:40:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:40:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:40:24 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:40:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:40:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:40:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:40:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:40:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:40:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:40:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:40:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:40:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:41:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:41:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:41:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:41:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:41:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:11 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:41:11 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:41:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:41:12 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:41:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:41:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:41:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:41:12 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:41:12 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating instance_info_cache with network_info: [{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:41:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:41:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:41:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:41:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:41:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:41:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:41:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:41:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:41:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:41:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:41:20 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:41:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:41:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:41:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:41:20 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:41:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk --force-share --output=json {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:20 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:20 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:41:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:21 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:41:21 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:41:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8691MB free_disk=25.155506134033203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:41:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:41:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:41:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 3086d9d8-ecd0-404a-9623-c2f21c194820 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:41:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:41:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:41:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:41:21 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:41:21 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:41:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:41:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:41:22 user nova-compute[72447]: DEBUG nova.compute.manager [req-a5c05796-1cd6-4a60-a75b-fdb4daae4bd1 req-69567ed4-7c06-4855-b806-77110feebca2 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Received event network-changed-7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:41:22 user nova-compute[72447]: DEBUG nova.compute.manager [req-a5c05796-1cd6-4a60-a75b-fdb4daae4bd1 req-69567ed4-7c06-4855-b806-77110feebca2 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Refreshing instance network info cache due to event network-changed-7ac7766a-5be3-444f-a253-dfc3c891ba11. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:41:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a5c05796-1cd6-4a60-a75b-fdb4daae4bd1 req-69567ed4-7c06-4855-b806-77110feebca2 service nova] Acquiring lock "refresh_cache-3086d9d8-ecd0-404a-9623-c2f21c194820" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:41:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a5c05796-1cd6-4a60-a75b-fdb4daae4bd1 req-69567ed4-7c06-4855-b806-77110feebca2 service nova] Acquired lock "refresh_cache-3086d9d8-ecd0-404a-9623-c2f21c194820" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:41:22 user nova-compute[72447]: DEBUG nova.network.neutron [req-a5c05796-1cd6-4a60-a75b-fdb4daae4bd1 req-69567ed4-7c06-4855-b806-77110feebca2 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Refreshing network info cache for port 7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:41:23 user nova-compute[72447]: DEBUG nova.network.neutron [req-a5c05796-1cd6-4a60-a75b-fdb4daae4bd1 req-69567ed4-7c06-4855-b806-77110feebca2 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Updated VIF entry in instance network info cache for port 7ac7766a-5be3-444f-a253-dfc3c891ba11. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:41:23 user nova-compute[72447]: DEBUG nova.network.neutron [req-a5c05796-1cd6-4a60-a75b-fdb4daae4bd1 req-69567ed4-7c06-4855-b806-77110feebca2 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Updating instance_info_cache with network_info: [{"id": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "address": "fa:16:3e:f7:c5:13", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac7766a-5b", "ovs_interfaceid": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:41:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a5c05796-1cd6-4a60-a75b-fdb4daae4bd1 req-69567ed4-7c06-4855-b806-77110feebca2 service nova] Releasing lock "refresh_cache-3086d9d8-ecd0-404a-9623-c2f21c194820" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:41:23 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:41:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:41:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 3086d9d8-ecd0-404a-9623-c2f21c194820 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:41:26 user nova-compute[72447]: INFO nova.compute.manager [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Attaching volume 4286dd37-6bae-4023-9847-179a5af5c9f5 to /dev/vdb
Jul 31 12:41:26 user nova-compute[72447]: DEBUG os_brick.utils [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[264a0515-db1a-4944-a8e5-e54e7ad0570b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e8fa87-a134-4d25-872f-2548a319e2bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4789755d-91d5-4628-9eb9-359ce9a3ad06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b0b5ba-8cda-4e7c-a06a-b8f86def74d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:41:26 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:41:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[697c58da-f635-4c37-b573-45847241cea8]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG os_brick.utils [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:41:26 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Updating existing volume attachment record: 52e6bfcf-ecf2-45c3-a642-34784642f379 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:41:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-2eb445e4-1686-49ef-981b-e214b23d3c07 req-ff5f973a-274a-4c62-910a-17b9d7a0b366 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-changed-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:41:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-2eb445e4-1686-49ef-981b-e214b23d3c07 req-ff5f973a-274a-4c62-910a-17b9d7a0b366 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Refreshing instance network info cache due to event network-changed-7c71e1bc-cb13-4391-aae1-93f292af5eaa. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:41:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2eb445e4-1686-49ef-981b-e214b23d3c07 req-ff5f973a-274a-4c62-910a-17b9d7a0b366 service nova] Acquiring lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:41:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2eb445e4-1686-49ef-981b-e214b23d3c07 req-ff5f973a-274a-4c62-910a-17b9d7a0b366 service nova] Acquired lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:41:28 user nova-compute[72447]: DEBUG nova.network.neutron [req-2eb445e4-1686-49ef-981b-e214b23d3c07 req-ff5f973a-274a-4c62-910a-17b9d7a0b366 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Refreshing network info cache for port 7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:41:29 user nova-compute[72447]: DEBUG nova.network.neutron [req-2eb445e4-1686-49ef-981b-e214b23d3c07 req-ff5f973a-274a-4c62-910a-17b9d7a0b366 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updated VIF entry in instance network info cache for port 7c71e1bc-cb13-4391-aae1-93f292af5eaa. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:41:29 user nova-compute[72447]: DEBUG nova.network.neutron [req-2eb445e4-1686-49ef-981b-e214b23d3c07 req-ff5f973a-274a-4c62-910a-17b9d7a0b366 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating instance_info_cache with network_info: [{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:41:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2eb445e4-1686-49ef-981b-e214b23d3c07 req-ff5f973a-274a-4c62-910a-17b9d7a0b366 service nova] Releasing lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:41:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:41:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:41:29 user nova-compute[72447]: INFO nova.compute.manager [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Shelve offloading
Jul 31 12:41:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:30 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Instance destroyed successfully.
Jul 31 12:41:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquired lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG nova.network.neutron [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-c8ed36e7-c4bd-4eb6-9fd3-61216b130369 req-4c1d4b2e-81a5-4ec5-97d8-96fa1a2671d1 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-vif-unplugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c8ed36e7-c4bd-4eb6-9fd3-61216b130369 req-4c1d4b2e-81a5-4ec5-97d8-96fa1a2671d1 service nova] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c8ed36e7-c4bd-4eb6-9fd3-61216b130369 req-4c1d4b2e-81a5-4ec5-97d8-96fa1a2671d1 service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c8ed36e7-c4bd-4eb6-9fd3-61216b130369 req-4c1d4b2e-81a5-4ec5-97d8-96fa1a2671d1 service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-c8ed36e7-c4bd-4eb6-9fd3-61216b130369 req-4c1d4b2e-81a5-4ec5-97d8-96fa1a2671d1 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] No waiting events found dispatching network-vif-unplugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:41:30 user nova-compute[72447]: WARNING nova.compute.manager [req-c8ed36e7-c4bd-4eb6-9fd3-61216b130369 req-4c1d4b2e-81a5-4ec5-97d8-96fa1a2671d1 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received unexpected event network-vif-unplugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa for instance with vm_state active and task_state shelving.
Jul 31 12:41:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-c8ed36e7-c4bd-4eb6-9fd3-61216b130369 req-4c1d4b2e-81a5-4ec5-97d8-96fa1a2671d1 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c8ed36e7-c4bd-4eb6-9fd3-61216b130369 req-4c1d4b2e-81a5-4ec5-97d8-96fa1a2671d1 service nova] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c8ed36e7-c4bd-4eb6-9fd3-61216b130369 req-4c1d4b2e-81a5-4ec5-97d8-96fa1a2671d1 service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c8ed36e7-c4bd-4eb6-9fd3-61216b130369 req-4c1d4b2e-81a5-4ec5-97d8-96fa1a2671d1 service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-c8ed36e7-c4bd-4eb6-9fd3-61216b130369 req-4c1d4b2e-81a5-4ec5-97d8-96fa1a2671d1 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] No waiting events found dispatching network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:41:30 user nova-compute[72447]: WARNING nova.compute.manager [req-c8ed36e7-c4bd-4eb6-9fd3-61216b130369 req-4c1d4b2e-81a5-4ec5-97d8-96fa1a2671d1 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received unexpected event network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa for instance with vm_state active and task_state shelving.
Jul 31 12:41:30 user nova-compute[72447]: DEBUG nova.network.neutron [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating instance_info_cache with network_info: [{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:41:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Releasing lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:31 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Instance destroyed successfully.
Jul 31 12:41:31 user nova-compute[72447]: DEBUG nova.objects.instance [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lazy-loading 'resources' on Instance uuid 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1864140187',display_name='tempest-TestShelveInstance-server-1864140187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1864140187',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ03gNLjoCPcs12yPAxccibhYxpPl/qrIlTnezq1CyDr0QNdT8G9WzvloMs7cHUg5kcQo6A89NB7m7vFODXRWKlJx0C7YVLnbkSxoTCTyfDIKAzvMZ8k8xuAIpNAGybmw==',key_name='tempest-TestShelveInstance-1517846330',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:39:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce85700824de42378524bbe3b028cc43',ramdisk_id='',reservation_id='r-fygzdt90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-158902571',owner_user_name='tempest-TestShelveInstance-158902571-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:39:49Z,user_data=None,user_id='41a7e247ef274dc9b1fc3fd75a6005f1',uuid=61fd2bb6-953a-4803-81bd-d1f03c1bc8a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Converting VIF {"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_vif [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c71e1bc-cb, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:41:31 user nova-compute[72447]: INFO os_vif [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb')
Jul 31 12:41:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsUmHgXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:41:31 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-73327ef6-d7e2-4ae2-978f-ec5a5799663a req-8b542a89-23cc-4baf-b45d-fee4afcc7412 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-changed-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG nova.compute.manager [req-73327ef6-d7e2-4ae2-978f-ec5a5799663a req-8b542a89-23cc-4baf-b45d-fee4afcc7412 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Refreshing instance network info cache due to event network-changed-7c71e1bc-cb13-4391-aae1-93f292af5eaa. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73327ef6-d7e2-4ae2-978f-ec5a5799663a req-8b542a89-23cc-4baf-b45d-fee4afcc7412 service nova] Acquiring lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73327ef6-d7e2-4ae2-978f-ec5a5799663a req-8b542a89-23cc-4baf-b45d-fee4afcc7412 service nova] Acquired lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-73327ef6-d7e2-4ae2-978f-ec5a5799663a req-8b542a89-23cc-4baf-b45d-fee4afcc7412 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Refreshing network info cache for port 7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[87799af5-70e2-490c-8d8b-75ede0604f92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a518b59f-f914-4adc-a197-821aac064ccf]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 (non-flash)
Jul 31 12:41:31 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 (non-flash)
Jul 31 12:41:31 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06686c7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[919914b5-d4e7-4a76-b3b5-d1611a87b672]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[068ea3c4-53a4-4690-9083-3419fc505824]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcb4416-722c-4949-8743-a6a95a18506a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[31875f71-bd8f-4d5a-a6dc-6b09b8fbf84f]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a503f5-c7ab-440d-9ca2-559556707e8e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ec0d2d-1bc5-41ba-ab0d-2dc4cce2c3c6]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260]
Jul 31 12:41:31 user nova-compute[72447]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260] successful.
Jul 31 12:41:31 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a707e94-0de5-446b-8c4c-fcab44fda8e1]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] <== disconnect_volume: return (281ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:41:31 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Deleting instance files /opt/stack/data/nova/instances/61fd2bb6-953a-4803-81bd-d1f03c1bc8a4_del
Jul 31 12:41:31 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Deletion of /opt/stack/data/nova/instances/61fd2bb6-953a-4803-81bd-d1f03c1bc8a4_del complete
Jul 31 12:41:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-73327ef6-d7e2-4ae2-978f-ec5a5799663a req-8b542a89-23cc-4baf-b45d-fee4afcc7412 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updated VIF entry in instance network info cache for port 7c71e1bc-cb13-4391-aae1-93f292af5eaa. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG nova.network.neutron [req-73327ef6-d7e2-4ae2-978f-ec5a5799663a req-8b542a89-23cc-4baf-b45d-fee4afcc7412 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating instance_info_cache with network_info: [{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": null, "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:41:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-73327ef6-d7e2-4ae2-978f-ec5a5799663a req-8b542a89-23cc-4baf-b45d-fee4afcc7412 service nova] Releasing lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:41:32 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Deleted allocations for instance 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4
Jul 31 12:41:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:41:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:41:32 user nova-compute[72447]: DEBUG nova.objects.instance [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lazy-loading 'numa_topology' on Instance uuid 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:41:32 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:41:32 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:41:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:41:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-81e21461-22c7-4b59-838f-13ff13a27345 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.888s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:41:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbSQXgeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:41:38 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:41:38 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:41:38 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c59eba-f356-4057-b6dc-61cacaeec24e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:41:38 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea1fcfc-5c37-4e6f-aa9a-8a98d48af627]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5] added
Jul 31 12:41:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.093s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a7ddb2-8e0f-4b9b-a4ec-78f7b7549209]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92545a9-c6aa-431e-be3c-e02608622c9b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbSQXgeC {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbSQXgeC" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd1ef49-8933-40b4-ba95-27dbd71488ea]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xbSQXgeC'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[837d5c37-2a89-4ad2-91f1-c0c75d547878]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e8e4db-4bb4-4156-b6bb-7587a7659f3b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:41:38 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:41:38 user nova-compute[72447]:  {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:41:38 user nova-compute[72447]: WARNING os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 12:41:38 user nova-compute[72447]: 
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a843702-c316-4b9b-8555-e3dde4c320bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5, portal: 172.16.0.220,3260]
Jul 31 12:41:38 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5, portal: 172.16.0.220,3260] successful.
Jul 31 12:41:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d86a53b-e454-46e6-b6a9-7f6e9a5bf445]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e3b916-914e-4ed8-a887-742cb5790d2f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 (non-flash)
Jul 31 12:41:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 (non-flash)
Jul 31 12:41:38 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99a3208-6e00-46ae-a388-06d4a229b483]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:41:38 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbSQXgeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:41:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:41:39 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26538636130383063', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:41:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538636130383063', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:41:39 user nova-compute[72447]: DEBUG nova.objects.instance [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 3086d9d8-ecd0-404a-9623-c2f21c194820 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:41:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:41:39 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:41:39 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:41:39 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:41:39 user nova-compute[72447]:   <serial>4286dd37-6bae-4023-9847-179a5af5c9f5</serial>
Jul 31 12:41:39 user nova-compute[72447]: </disk>
Jul 31 12:41:39 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:41:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:41:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:41:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No VIF found with MAC fa:16:3e:f7:c5:13, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:41:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-5834dbfb-aeb5-4b5e-96ad-22554300a82c tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.771s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:41:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG nova.objects.instance [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 3086d9d8-ecd0-404a-9623-c2f21c194820 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:41:44 user nova-compute[72447]: INFO nova.compute.manager [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Attaching volume e903bbbd-7567-4603-9af7-9eec0f38033a to /dev/vdc
Jul 31 12:41:44 user nova-compute[72447]: DEBUG os_brick.utils [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[528f604a-5cb6-4766-ba8c-aa0a0a347cba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0c6c54-039d-46d2-9cdc-c59e847e7d64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59bc268-0e91-4297-9d57-3fcae6d7730d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b842e30-1b1d-4c53-8b88-a4372dbb401f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:41:44 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:41:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e0b86f-81ee-46c8-a067-73e9c27c5193]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG os_brick.utils [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:41:44 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Updating existing volume attachment record: 08660e9c-338b-498d-8ab2-f19e878a399f {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:41:45 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690807290.0132184, 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:41:45 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] VM Stopped (Lifecycle Event)
Jul 31 12:41:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-eed7cd86-9d67-4c82-b1e1-62292b7c8ab2 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:41:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnlcXsfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:41:51 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:41:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:41:51 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:41:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:41:51 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6151329b-05a4-40d6-a32b-7b2944cd16ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:41:51 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae95e06a-f1ab-461a-ab0c-f2dcdb8e36a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a] added
Jul 31 12:41:51 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a112f05-240a-4a85-a932-91b8cc5d6912]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e1f552-e961-4a50-9175-8171871c7ab8]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:51 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EnlcXsfj {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EnlcXsfj" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22c2f08-7721-43a4-88b4-4ac09e424aca]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EnlcXsfj'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c4a3aa-474f-455f-bb58-4e0f16a7a4eb]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d403e9-66ec-4442-a71f-8680bd1d5cbe]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 (non-flash)
Jul 31 12:41:52 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 (non-flash)
Jul 31 12:41:52 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ec2577-ec10-415c-9819-fb35c05a9921]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a, portal: 172.16.0.220,3260]
Jul 31 12:41:52 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a, portal: 172.16.0.220,3260] successful.
Jul 31 12:41:52 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eafb840-5791-4b77-b367-8cc515340218]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80de73f-8dbe-4fcd-a96a-62743f870472]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 (non-flash)
Jul 31 12:41:52 user nova-compute[72447]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a (non-flash)
Jul 31 12:41:52 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 (non-flash)
Jul 31 12:41:52 user nova-compute[72447]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a (non-flash)
Jul 31 12:41:52 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd4a826-0f80-44df-abb5-5876794fa88e]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:52 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:41:53 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:41:53 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnlcXsfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:41:53 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:41:53 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23737363435323037', 'path': '/dev/sdc'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:41:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737363435323037', 'path': '/dev/sdc'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:41:53 user nova-compute[72447]: DEBUG nova.objects.instance [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 3086d9d8-ecd0-404a-9623-c2f21c194820 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:41:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 12:41:53 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:41:53 user nova-compute[72447]:   <source dev="/dev/sdc"/>
Jul 31 12:41:53 user nova-compute[72447]:   <target dev="vdc" bus="virtio"/>
Jul 31 12:41:53 user nova-compute[72447]:   <serial>e903bbbd-7567-4603-9af7-9eec0f38033a</serial>
Jul 31 12:41:53 user nova-compute[72447]: </disk>
Jul 31 12:41:53 user nova-compute[72447]:  {{(pid=72447) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 12:41:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:41:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:41:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:41:53 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] No VIF found with MAC fa:16:3e:f7:c5:13, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:41:53 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f708f6ee-ddba-4b77-babf-37b97664fc5e tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.338s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:41:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:41:54 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:41:54 user nova-compute[72447]: INFO nova.compute.manager [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Detaching volume 4286dd37-6bae-4023-9847-179a5af5c9f5
Jul 31 12:41:54 user nova-compute[72447]: INFO nova.virt.block_device [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Attempting to driver detach volume 4286dd37-6bae-4023-9847-179a5af5c9f5 from mountpoint /dev/vdb
Jul 31 12:41:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Attempting to detach device vdb from instance 3086d9d8-ecd0-404a-9623-c2f21c194820 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:41:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:41:54 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:41:54 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:41:54 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:41:54 user nova-compute[72447]:   <serial>4286dd37-6bae-4023-9847-179a5af5c9f5</serial>
Jul 31 12:41:54 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:41:54 user nova-compute[72447]: </disk>
Jul 31 12:41:54 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:41:54 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully detached device vdb from instance 3086d9d8-ecd0-404a-9623-c2f21c194820 from the persistent domain config.
Jul 31 12:41:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3086d9d8-ecd0-404a-9623-c2f21c194820 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:41:54 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:41:54 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:41:54 user nova-compute[72447]:   <source dev="/dev/sdb"/>
Jul 31 12:41:54 user nova-compute[72447]:   <target dev="vdb" bus="virtio"/>
Jul 31 12:41:54 user nova-compute[72447]:   <serial>4286dd37-6bae-4023-9847-179a5af5c9f5</serial>
Jul 31 12:41:54 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 12:41:54 user nova-compute[72447]: </disk>
Jul 31 12:41:54 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690807315.1144083, 3086d9d8-ecd0-404a-9623-c2f21c194820 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3086d9d8-ecd0-404a-9623-c2f21c194820 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:41:55 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully detached device vdb from instance 3086d9d8-ecd0-404a-9623-c2f21c194820 from the live domain config.
Jul 31 12:41:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbSQXgeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:41:55 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcdd2db-6457-484a-aded-17430d0839ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee212369-b02a-447f-a2ed-2e55817db118]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 (non-flash)
Jul 31 12:41:55 user nova-compute[72447]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a (non-flash)
Jul 31 12:41:55 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 (non-flash)
Jul 31 12:41:55 user nova-compute[72447]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a (non-flash)
Jul 31 12:41:55 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0670135000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8030e645-19ca-44fc-9dd1-945ac10e342a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0c81cb-d0c0-4b5d-88ad-c2c5db17f41b]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eff06a7-0504-4f80-b4f0-c4a158ec07af]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a34b521-e11c-4728-8afa-15fa9b07cf99]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27c8f39-5b78-4e32-a39e-28c2ce7547f5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ebad58-34cd-4b13-8907-3b2a74412fde]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5, portal: 172.16.0.220,3260]
Jul 31 12:41:55 user nova-compute[72447]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5, portal: 172.16.0.220,3260] successful.
Jul 31 12:41:55 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4286dd37-6bae-4023-9847-179a5af5c9f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[176a51b7-8376-46e2-9980-e187011ae437]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] <== disconnect_volume: return (322ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:41:55 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:41:56 user nova-compute[72447]: DEBUG nova.objects.instance [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 3086d9d8-ecd0-404a-9623-c2f21c194820 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:41:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-de7869d6-1560-4d7e-9350-a9b2d8a3e611 tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.744s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:41:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:41:57 user nova-compute[72447]: INFO nova.compute.manager [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Detaching volume e903bbbd-7567-4603-9af7-9eec0f38033a
Jul 31 12:41:57 user nova-compute[72447]: INFO nova.virt.block_device [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Attempting to driver detach volume e903bbbd-7567-4603-9af7-9eec0f38033a from mountpoint /dev/vdc
Jul 31 12:41:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Attempting to detach device vdc from instance 3086d9d8-ecd0-404a-9623-c2f21c194820 from the persistent domain config. {{(pid=72447) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:41:57 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:41:57 user nova-compute[72447]:   <source dev="/dev/sdc"/>
Jul 31 12:41:57 user nova-compute[72447]:   <target dev="vdc" bus="virtio"/>
Jul 31 12:41:57 user nova-compute[72447]:   <serial>e903bbbd-7567-4603-9af7-9eec0f38033a</serial>
Jul 31 12:41:57 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 12:41:57 user nova-compute[72447]: </disk>
Jul 31 12:41:57 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:41:57 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully detached device vdc from instance 3086d9d8-ecd0-404a-9623-c2f21c194820 from the persistent domain config.
Jul 31 12:41:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3086d9d8-ecd0-404a-9623-c2f21c194820 from the live domain config. {{(pid=72447) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.guest [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 12:41:57 user nova-compute[72447]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:41:57 user nova-compute[72447]:   <source dev="/dev/sdc"/>
Jul 31 12:41:57 user nova-compute[72447]:   <target dev="vdc" bus="virtio"/>
Jul 31 12:41:57 user nova-compute[72447]:   <serial>e903bbbd-7567-4603-9af7-9eec0f38033a</serial>
Jul 31 12:41:57 user nova-compute[72447]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 12:41:57 user nova-compute[72447]: </disk>
Jul 31 12:41:57 user nova-compute[72447]:  {{(pid=72447) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Received event <DeviceRemovedEvent: 1690807317.6275773, 3086d9d8-ecd0-404a-9623-c2f21c194820 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72447) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3086d9d8-ecd0-404a-9623-c2f21c194820 {{(pid=72447) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 12:41:57 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully detached device vdc from instance 3086d9d8-ecd0-404a-9623-c2f21c194820 from the live domain config.
Jul 31 12:41:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnlcXsfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:41:57 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52d34c8-63dd-4c7b-a9b3-40fd2792ee4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b311ffa-a4cc-4c37-aca4-926572cd8536]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a (non-flash)
Jul 31 12:41:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a (non-flash)
Jul 31 12:41:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06683e1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a'): ({'sdc'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Removing single pathed devices sdc {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d8f6e-ec76-4455-b598-5328cdcac98c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[261c681f-ce7d-4b37-9f2a-3730ca79d5b9]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Flushing IO for device /dev/sdc {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff665bee-c462-4b94-b819-257082593d61]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cbc0b4-0f9a-4360-81c0-0ee79c61c18a]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1f0004-b440-406f-823c-4a2c6ec08c4c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f110da-dcd7-49e9-9672-8ac12e7ee0aa]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a, portal: 172.16.0.220,3260]
Jul 31 12:41:57 user nova-compute[72447]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a, portal: 172.16.0.220,3260] successful.
Jul 31 12:41:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e903bbbd-7567-4603-9af7-9eec0f38033a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d61003-128b-416b-ab49-6665c28dde62]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.232s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] <== disconnect_volume: return (233ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:41:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:41:58 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'flavor' on Instance uuid 3086d9d8-ecd0-404a-9623-c2f21c194820 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:41:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4e6a4d76-ed34-4fa6-8cf9-2eabec98c4ec tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.666s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:42:00 user nova-compute[72447]: INFO nova.compute.manager [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Terminating instance
Jul 31 12:42:00 user nova-compute[72447]: DEBUG nova.compute.manager [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG nova.compute.manager [req-55dc1ea6-34c3-4c56-90c3-ee31319454ca req-2f0edecc-2340-4224-ae54-0dcb6007d99a service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Received event network-vif-unplugged-7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-55dc1ea6-34c3-4c56-90c3-ee31319454ca req-2f0edecc-2340-4224-ae54-0dcb6007d99a service nova] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-55dc1ea6-34c3-4c56-90c3-ee31319454ca req-2f0edecc-2340-4224-ae54-0dcb6007d99a service nova] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-55dc1ea6-34c3-4c56-90c3-ee31319454ca req-2f0edecc-2340-4224-ae54-0dcb6007d99a service nova] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG nova.compute.manager [req-55dc1ea6-34c3-4c56-90c3-ee31319454ca req-2f0edecc-2340-4224-ae54-0dcb6007d99a service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] No waiting events found dispatching network-vif-unplugged-7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG nova.compute.manager [req-55dc1ea6-34c3-4c56-90c3-ee31319454ca req-2f0edecc-2340-4224-ae54-0dcb6007d99a service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Received event network-vif-unplugged-7ac7766a-5be3-444f-a253-dfc3c891ba11 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:42:00 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Instance destroyed successfully.
Jul 31 12:42:00 user nova-compute[72447]: DEBUG nova.objects.instance [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lazy-loading 'resources' on Instance uuid 3086d9d8-ecd0-404a-9623-c2f21c194820 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1130701348',display_name='tempest-AttachVolumeTestJSON-server-1130701348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1130701348',id=44,image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9iBh1Ovg7zhbmo2n5JxC5Wy+eFHfcV4V65+a7owIOmYGleLpsnH1N8XG4j8yWTz+agd/CCnT/V7UcPNBMptR6EK52v4ryCuCSXkt5087yfr4gGA57uOHgZxdB+gkp5yg==',key_name='tempest-keypair-1536022868',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:39:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f7c1764cced4b49ad8e55759362a8db',ramdisk_id='',reservation_id='r-owob4u4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e1118021-a8cd-4e2b-b5b6-62d0c4085b6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-182433734',owner_user_name='tempest-AttachVolumeTestJSON-182433734-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33486507bb4141d1a1753054199bce56',uuid=3086d9d8-ecd0-404a-9623-c2f21c194820,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "address": "fa:16:3e:f7:c5:13", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac7766a-5b", "ovs_interfaceid": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converting VIF {"id": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "address": "fa:16:3e:f7:c5:13", "network": {"id": "8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1530872923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f7c1764cced4b49ad8e55759362a8db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac7766a-5b", "ovs_interfaceid": "7ac7766a-5be3-444f-a253-dfc3c891ba11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=7ac7766a-5be3-444f-a253-dfc3c891ba11,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac7766a-5b') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG os_vif [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=7ac7766a-5be3-444f-a253-dfc3c891ba11,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac7766a-5b') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ac7766a-5b, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:42:00 user nova-compute[72447]: INFO os_vif [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=7ac7766a-5be3-444f-a253-dfc3c891ba11,network=Network(8b45ddfc-33fa-4ab5-b55c-bda2fdfa1efa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac7766a-5b')
Jul 31 12:42:00 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Deleting instance files /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820_del
Jul 31 12:42:00 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Deletion of /opt/stack/data/nova/instances/3086d9d8-ecd0-404a-9623-c2f21c194820_del complete
Jul 31 12:42:00 user nova-compute[72447]: INFO nova.compute.manager [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Took 0.83 seconds to destroy the instance on the hypervisor.
Jul 31 12:42:00 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:42:00 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:42:01 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:42:01 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Took 0.84 seconds to deallocate network for instance.
Jul 31 12:42:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:42:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:42:01 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:42:01 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:42:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:42:01 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Deleted allocations for instance 3086d9d8-ecd0-404a-9623-c2f21c194820
Jul 31 12:42:01 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-cf8dbde5-2a8e-41e3-9b5b-849172dc8e7d tempest-AttachVolumeTestJSON-182433734 tempest-AttachVolumeTestJSON-182433734-project-member] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.975s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:42:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-cef1c49f-a096-4fff-b600-ff3fd1a82df4 req-566a42c1-1e27-40e3-8129-4744d91ce039 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Received event network-vif-plugged-7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:42:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cef1c49f-a096-4fff-b600-ff3fd1a82df4 req-566a42c1-1e27-40e3-8129-4744d91ce039 service nova] Acquiring lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:42:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cef1c49f-a096-4fff-b600-ff3fd1a82df4 req-566a42c1-1e27-40e3-8129-4744d91ce039 service nova] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:42:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-cef1c49f-a096-4fff-b600-ff3fd1a82df4 req-566a42c1-1e27-40e3-8129-4744d91ce039 service nova] Lock "3086d9d8-ecd0-404a-9623-c2f21c194820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:42:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-cef1c49f-a096-4fff-b600-ff3fd1a82df4 req-566a42c1-1e27-40e3-8129-4744d91ce039 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] No waiting events found dispatching network-vif-plugged-7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:42:02 user nova-compute[72447]: WARNING nova.compute.manager [req-cef1c49f-a096-4fff-b600-ff3fd1a82df4 req-566a42c1-1e27-40e3-8129-4744d91ce039 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Received unexpected event network-vif-plugged-7ac7766a-5be3-444f-a253-dfc3c891ba11 for instance with vm_state deleted and task_state None.
Jul 31 12:42:02 user nova-compute[72447]: DEBUG nova.compute.manager [req-cef1c49f-a096-4fff-b600-ff3fd1a82df4 req-566a42c1-1e27-40e3-8129-4744d91ce039 service nova] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Received event network-vif-deleted-7ac7766a-5be3-444f-a253-dfc3c891ba11 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:42:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:12 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:42:13 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:42:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:42:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:42:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:42:13 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:42:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:42:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:42:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72447) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 12:42:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:42:15 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690807320.7488594, 3086d9d8-ecd0-404a-9623-c2f21c194820 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:42:15 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] VM Stopped (Lifecycle Event)
Jul 31 12:42:15 user nova-compute[72447]: DEBUG nova.compute.manager [None req-710a34cc-59b2-4696-9df1-e41ae06e0b9b None None] [instance: 3086d9d8-ecd0-404a-9623-c2f21c194820] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:42:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:42:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:42:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:42:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:42:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:42:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:42:20 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:42:20 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:42:20 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=25.181411743164062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing inventories for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating ProviderTree inventory for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 12:42:20 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing aggregate associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, aggregates: None {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 12:42:21 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing trait associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 12:42:21 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:42:21 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:42:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:42:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:42:24 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:42:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:42:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:42:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:42:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:42:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:26 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:42:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:42:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 12:42:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] There are 0 instances to clean {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 12:42:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:42:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:42:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:42:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:42:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:42:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:42:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:42:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:42:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:43:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:43:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:13 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:43:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:43:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:43:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:43:13 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:43:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:43:15 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:43:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:43:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:43:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:43:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:43:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:43:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:43:20 user nova-compute[72447]: INFO nova.compute.manager [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Unshelving
Jul 31 12:43:20 user nova-compute[72447]: INFO nova.virt.block_device [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Booting with volume 42560baf-28a9-41c7-8308-2df68f8f8ba7 at /dev/vda
Jul 31 12:43:21 user nova-compute[72447]: DEBUG os_brick.utils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c33e3b5-0c4e-47d7-a381-3b157a1258c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9cc4ba-7374-482b-ad68-a2a38c4f7d73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5b399f-4a6c-46a4-817d-d85a57a51e96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[087f660f-c485-42cc-a1c4-03aba126e67c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:43:21 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3694fe4e-2611-43c7-b890-7b0ef5bc17a6]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG os_brick.utils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating existing volume attachment record: ec5b07b1-5857-43cf-92f5-cdd205ae1d43 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:43:21 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:43:21 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:43:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=25.17935562133789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:43:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:43:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:43:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:43:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:43:27 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:43:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:43:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:43:28 user nova-compute[72447]: DEBUG nova.objects.instance [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lazy-loading 'pci_requests' on Instance uuid 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:43:28 user nova-compute[72447]: DEBUG nova.objects.instance [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lazy-loading 'numa_topology' on Instance uuid 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:43:28 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:43:28 user nova-compute[72447]: INFO nova.compute.claims [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Claim successful on node user
Jul 31 12:43:28 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:43:28 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:43:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:43:28 user nova-compute[72447]: INFO nova.network.neutron [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating port 7c71e1bc-cb13-4391-aae1-93f292af5eaa with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquired lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.network.neutron [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-a3ec7ff9-e640-4eb8-8da3-08a7ca4468cb req-cec1a69f-18f6-4ea5-aa15-9499067d2787 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-changed-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.compute.manager [req-a3ec7ff9-e640-4eb8-8da3-08a7ca4468cb req-cec1a69f-18f6-4ea5-aa15-9499067d2787 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Refreshing instance network info cache due to event network-changed-7c71e1bc-cb13-4391-aae1-93f292af5eaa. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a3ec7ff9-e640-4eb8-8da3-08a7ca4468cb req-cec1a69f-18f6-4ea5-aa15-9499067d2787 service nova] Acquiring lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.network.neutron [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating instance_info_cache with network_info: [{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Releasing lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:43:29 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Creating image(s)
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Ensure instance console log exists: /opt/stack/data/nova/instances/61fd2bb6-953a-4803-81bd-d1f03c1bc8a4/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Start _get_guest_xml network_info=[{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'ec5b07b1-5857-43cf-92f5-cdd205ae1d43', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsUmHgXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '61fd2bb6-953a-4803-81bd-d1f03c1bc8a4', 'attached_at': '', 'detached_at': '', 'volume_id': '42560baf-28a9-41c7-8308-2df68f8f8ba7', 'serial': '42560baf-28a9-41c7-8308-2df68f8f8ba7'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a3ec7ff9-e640-4eb8-8da3-08a7ca4468cb req-cec1a69f-18f6-4ea5-aa15-9499067d2787 service nova] Acquired lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.network.neutron [req-a3ec7ff9-e640-4eb8-8da3-08a7ca4468cb req-cec1a69f-18f6-4ea5-aa15-9499067d2787 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Refreshing network info cache for port 7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:43:29 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:43:29 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.objects.instance [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsUmHgXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:43:29 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:43:29 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:43:29 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4541f1-e9e5-4859-84b0-551e39e9f77c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:43:29 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d577b32-da38-4cf7-ab76-d260f955d15f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7] added
Jul 31 12:43:29 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55e0768-069f-4894-af3b-93b3b5c1ec31]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d2f6c1-44cc-4ebb-9236-9460f6cb164c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xsUmHgXu {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xsUmHgXu" returned: 0 in 0.032s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1293c85-df86-4fa3-be7f-0234cb137d9f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xsUmHgXu'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77ac205-cc11-4f29-9376-949de188ee59]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6373b22a-a7d7-4f0b-9e34-2fd487165448]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:43:29 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:43:29 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:43:29 user nova-compute[72447]:  {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:43:29 user nova-compute[72447]: WARNING os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 12:43:29 user nova-compute[72447]: 
Jul 31 12:43:29 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[21daab45-7285-4349-a76b-310218e2c2fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260]
Jul 31 12:43:30 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260] successful.
Jul 31 12:43:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[40defbc4-6e6d-47f5-b1ed-8a7a05b45c79]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a8dfc1-b519-45fc-bdcb-8f9217001805]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 (non-flash)
Jul 31 12:43:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 (non-flash)
Jul 31 12:43:30 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[57177d44-dadb-4e2c-8e3b-2e8aa69e06ea]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsUmHgXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG nova.network.neutron [req-a3ec7ff9-e640-4eb8-8da3-08a7ca4468cb req-cec1a69f-18f6-4ea5-aa15-9499067d2787 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updated VIF entry in instance network info cache for port 7c71e1bc-cb13-4391-aae1-93f292af5eaa. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG nova.network.neutron [req-a3ec7ff9-e640-4eb8-8da3-08a7ca4468cb req-cec1a69f-18f6-4ea5-aa15-9499067d2787 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating instance_info_cache with network_info: [{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a3ec7ff9-e640-4eb8-8da3-08a7ca4468cb req-cec1a69f-18f6-4ea5-aa15-9499067d2787 service nova] Releasing lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:43:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26161646264646161', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161646264646161', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1864140187',display_name='tempest-TestShelveInstance-server-1864140187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1864140187',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1517846330',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:39:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ce85700824de42378524bbe3b028cc43',ramdisk_id='',reservation_id='r-fygzdt90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-158902571',owner_user_name='tempest-TestShelveInstance-158902571-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:43:21Z,user_data=None,user_id='41a7e247ef274dc9b1fc3fd75a6005f1',uuid=61fd2bb6-953a-4803-81bd-d1f03c1bc8a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Converting VIF {"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG nova.objects.instance [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lazy-loading 'pci_devices' on Instance uuid 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:43:31 user nova-compute[72447]:   <uuid>61fd2bb6-953a-4803-81bd-d1f03c1bc8a4</uuid>
Jul 31 12:43:31 user nova-compute[72447]:   <name>instance-0000002d</name>
Jul 31 12:43:31 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:43:31 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:43:31 user nova-compute[72447]:   <metadata>
Jul 31 12:43:31 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:43:31 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:43:31 user nova-compute[72447]:       <nova:name>tempest-TestShelveInstance-server-1864140187</nova:name>
Jul 31 12:43:31 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:43:29</nova:creationTime>
Jul 31 12:43:31 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:43:31 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:43:31 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:43:31 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:43:31 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:43:31 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:43:31 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:43:31 user nova-compute[72447]:       <nova:owner>
Jul 31 12:43:31 user nova-compute[72447]:         <nova:user uuid="41a7e247ef274dc9b1fc3fd75a6005f1">tempest-TestShelveInstance-158902571-project-member</nova:user>
Jul 31 12:43:31 user nova-compute[72447]:         <nova:project uuid="ce85700824de42378524bbe3b028cc43">tempest-TestShelveInstance-158902571</nova:project>
Jul 31 12:43:31 user nova-compute[72447]:       </nova:owner>
Jul 31 12:43:31 user nova-compute[72447]:       <nova:ports>
Jul 31 12:43:31 user nova-compute[72447]:         <nova:port uuid="7c71e1bc-cb13-4391-aae1-93f292af5eaa">
Jul 31 12:43:31 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:43:31 user nova-compute[72447]:         </nova:port>
Jul 31 12:43:31 user nova-compute[72447]:       </nova:ports>
Jul 31 12:43:31 user nova-compute[72447]:     </nova:instance>
Jul 31 12:43:31 user nova-compute[72447]:   </metadata>
Jul 31 12:43:31 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:43:31 user nova-compute[72447]:     <system>
Jul 31 12:43:31 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:43:31 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:43:31 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:43:31 user nova-compute[72447]:       <entry name="serial">61fd2bb6-953a-4803-81bd-d1f03c1bc8a4</entry>
Jul 31 12:43:31 user nova-compute[72447]:       <entry name="uuid">61fd2bb6-953a-4803-81bd-d1f03c1bc8a4</entry>
Jul 31 12:43:31 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:43:31 user nova-compute[72447]:     </system>
Jul 31 12:43:31 user nova-compute[72447]:   </sysinfo>
Jul 31 12:43:31 user nova-compute[72447]:   <os>
Jul 31 12:43:31 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:43:31 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:43:31 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:43:31 user nova-compute[72447]:   </os>
Jul 31 12:43:31 user nova-compute[72447]:   <features>
Jul 31 12:43:31 user nova-compute[72447]:     <acpi/>
Jul 31 12:43:31 user nova-compute[72447]:     <apic/>
Jul 31 12:43:31 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:43:31 user nova-compute[72447]:   </features>
Jul 31 12:43:31 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:43:31 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:43:31 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:43:31 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:43:31 user nova-compute[72447]:   </clock>
Jul 31 12:43:31 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:43:31 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:43:31 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:43:31 user nova-compute[72447]:   </cpu>
Jul 31 12:43:31 user nova-compute[72447]:   <devices>
Jul 31 12:43:31 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:43:31 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:43:31 user nova-compute[72447]:       <source dev="/dev/sdb"/>
Jul 31 12:43:31 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:43:31 user nova-compute[72447]:       <serial>42560baf-28a9-41c7-8308-2df68f8f8ba7</serial>
Jul 31 12:43:31 user nova-compute[72447]:     </disk>
Jul 31 12:43:31 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:43:31 user nova-compute[72447]:       <mac address="fa:16:3e:41:db:7f"/>
Jul 31 12:43:31 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:43:31 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:43:31 user nova-compute[72447]:       <target dev="tap7c71e1bc-cb"/>
Jul 31 12:43:31 user nova-compute[72447]:     </interface>
Jul 31 12:43:31 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:43:31 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/61fd2bb6-953a-4803-81bd-d1f03c1bc8a4/console.log" append="off"/>
Jul 31 12:43:31 user nova-compute[72447]:     </serial>
Jul 31 12:43:31 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:43:31 user nova-compute[72447]:     <video>
Jul 31 12:43:31 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:43:31 user nova-compute[72447]:     </video>
Jul 31 12:43:31 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:43:31 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:43:31 user nova-compute[72447]:     </rng>
Jul 31 12:43:31 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:43:31 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:43:31 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:43:31 user nova-compute[72447]:     </memballoon>
Jul 31 12:43:31 user nova-compute[72447]:   </devices>
Jul 31 12:43:31 user nova-compute[72447]: </domain>
Jul 31 12:43:31 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1864140187',display_name='tempest-TestShelveInstance-server-1864140187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1864140187',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1517846330',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:39:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ce85700824de42378524bbe3b028cc43',ramdisk_id='',reservation_id='r-fygzdt90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-158902571',owner_user_name='tempest-TestShelveInstance-158902571-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:43:21Z,user_data=None,user_id='41a7e247ef274dc9b1fc3fd75a6005f1',uuid=61fd2bb6-953a-4803-81bd-d1f03c1bc8a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Converting VIF {"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG os_vif [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c71e1bc-cb, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c71e1bc-cb, col_values=(('external_ids', {'iface-id': '7c71e1bc-cb13-4391-aae1-93f292af5eaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:db:7f', 'vm-uuid': '61fd2bb6-953a-4803-81bd-d1f03c1bc8a4'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:31 user nova-compute[72447]: INFO os_vif [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb')
Jul 31 12:43:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:43:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] No VIF found with MAC fa:16:3e:41:db:7f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:43:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:32 user nova-compute[72447]: DEBUG nova.compute.manager [req-7b8a73ea-fd78-437e-b794-eb1fc3bf579a req-17c7f7af-38be-43e5-87ff-28335ddafc4f service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:43:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7b8a73ea-fd78-437e-b794-eb1fc3bf579a req-17c7f7af-38be-43e5-87ff-28335ddafc4f service nova] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:43:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7b8a73ea-fd78-437e-b794-eb1fc3bf579a req-17c7f7af-38be-43e5-87ff-28335ddafc4f service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:43:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7b8a73ea-fd78-437e-b794-eb1fc3bf579a req-17c7f7af-38be-43e5-87ff-28335ddafc4f service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:43:32 user nova-compute[72447]: DEBUG nova.compute.manager [req-7b8a73ea-fd78-437e-b794-eb1fc3bf579a req-17c7f7af-38be-43e5-87ff-28335ddafc4f service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] No waiting events found dispatching network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:43:32 user nova-compute[72447]: WARNING nova.compute.manager [req-7b8a73ea-fd78-437e-b794-eb1fc3bf579a req-17c7f7af-38be-43e5-87ff-28335ddafc4f service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received unexpected event network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 12:43:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:34 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807414.8125587, 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:43:34 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] VM Resumed (Lifecycle Event)
Jul 31 12:43:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:43:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:43:34 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Instance spawned successfully.
Jul 31 12:43:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:43:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:43:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-95616333-32d6-4765-a42f-1ce76d936572 req-c3638e32-0f7a-4a8f-ad3f-f29b81f245e1 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:43:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-95616333-32d6-4765-a42f-1ce76d936572 req-c3638e32-0f7a-4a8f-ad3f-f29b81f245e1 service nova] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:43:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-95616333-32d6-4765-a42f-1ce76d936572 req-c3638e32-0f7a-4a8f-ad3f-f29b81f245e1 service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:43:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-95616333-32d6-4765-a42f-1ce76d936572 req-c3638e32-0f7a-4a8f-ad3f-f29b81f245e1 service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:43:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-95616333-32d6-4765-a42f-1ce76d936572 req-c3638e32-0f7a-4a8f-ad3f-f29b81f245e1 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] No waiting events found dispatching network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:43:34 user nova-compute[72447]: WARNING nova.compute.manager [req-95616333-32d6-4765-a42f-1ce76d936572 req-c3638e32-0f7a-4a8f-ad3f-f29b81f245e1 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received unexpected event network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 12:43:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:43:34 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:43:34 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807414.816212, 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:43:34 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] VM Started (Lifecycle Event)
Jul 31 12:43:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-680c9a4f-940e-4ecc-a860-ebc85bcb18c9 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.007s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:43:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:43:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:43:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:43:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:43:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:43:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:43:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:43:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:44:14 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:44:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:44:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:44:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:44:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:44:14 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:44:14 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:44:14 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating instance_info_cache with network_info: [{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:44:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:44:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:44:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:44:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:44:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:44:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:44:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:44:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:16 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:44:16 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:44:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:44:20 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:44:21 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:44:21 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:44:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=25.16854476928711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:44:21 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:44:22 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:44:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:44:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:44:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:44:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:44:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:44:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:44:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:44:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:44:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:44:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:44:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:44:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:44:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:44:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:44:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:44:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:44:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:44:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:44:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:44:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:44:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:44:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:45:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:45:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:45:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:45:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:45:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:45:12 user nova-compute[72447]: INFO nova.compute.manager [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Terminating instance
Jul 31 12:45:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-3864ac09-5c6e-4945-81eb-237263c5b0f5 req-cf5c377d-70c6-4523-a5a4-56bddd57b5bf service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-changed-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-3864ac09-5c6e-4945-81eb-237263c5b0f5 req-cf5c377d-70c6-4523-a5a4-56bddd57b5bf service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Refreshing instance network info cache due to event network-changed-7c71e1bc-cb13-4391-aae1-93f292af5eaa. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3864ac09-5c6e-4945-81eb-237263c5b0f5 req-cf5c377d-70c6-4523-a5a4-56bddd57b5bf service nova] Acquiring lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3864ac09-5c6e-4945-81eb-237263c5b0f5 req-cf5c377d-70c6-4523-a5a4-56bddd57b5bf service nova] Acquired lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG nova.network.neutron [req-3864ac09-5c6e-4945-81eb-237263c5b0f5 req-cf5c377d-70c6-4523-a5a4-56bddd57b5bf service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Refreshing network info cache for port 7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-601b9a5b-3044-499f-8195-e4056dd82b02 req-d5dd622d-6ebd-4090-a0a8-49916278241d service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-vif-unplugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-601b9a5b-3044-499f-8195-e4056dd82b02 req-d5dd622d-6ebd-4090-a0a8-49916278241d service nova] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-601b9a5b-3044-499f-8195-e4056dd82b02 req-d5dd622d-6ebd-4090-a0a8-49916278241d service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-601b9a5b-3044-499f-8195-e4056dd82b02 req-d5dd622d-6ebd-4090-a0a8-49916278241d service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-601b9a5b-3044-499f-8195-e4056dd82b02 req-d5dd622d-6ebd-4090-a0a8-49916278241d service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] No waiting events found dispatching network-vif-unplugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG nova.compute.manager [req-601b9a5b-3044-499f-8195-e4056dd82b02 req-d5dd622d-6ebd-4090-a0a8-49916278241d service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-vif-unplugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG nova.network.neutron [req-3864ac09-5c6e-4945-81eb-237263c5b0f5 req-cf5c377d-70c6-4523-a5a4-56bddd57b5bf service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updated VIF entry in instance network info cache for port 7c71e1bc-cb13-4391-aae1-93f292af5eaa. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG nova.network.neutron [req-3864ac09-5c6e-4945-81eb-237263c5b0f5 req-cf5c377d-70c6-4523-a5a4-56bddd57b5bf service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating instance_info_cache with network_info: [{"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:45:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3864ac09-5c6e-4945-81eb-237263c5b0f5 req-cf5c377d-70c6-4523-a5a4-56bddd57b5bf service nova] Releasing lock "refresh_cache-61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:45:13 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Instance destroyed successfully.
Jul 31 12:45:13 user nova-compute[72447]: DEBUG nova.objects.instance [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lazy-loading 'resources' on Instance uuid 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T12:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1864140187',display_name='tempest-TestShelveInstance-server-1864140187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1864140187',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ03gNLjoCPcs12yPAxccibhYxpPl/qrIlTnezq1CyDr0QNdT8G9WzvloMs7cHUg5kcQo6A89NB7m7vFODXRWKlJx0C7YVLnbkSxoTCTyfDIKAzvMZ8k8xuAIpNAGybmw==',key_name='tempest-TestShelveInstance-1517846330',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce85700824de42378524bbe3b028cc43',ramdisk_id='',reservation_id='r-fygzdt90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-158902571',owner_user_name='tempest-TestShelveInstance-158902571-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:43:35Z,user_data=None,user_id='41a7e247ef274dc9b1fc3fd75a6005f1',uuid=61fd2bb6-953a-4803-81bd-d1f03c1bc8a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Converting VIF {"id": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "address": "fa:16:3e:41:db:7f", "network": {"id": "07c5d950-ba0f-4b71-935f-9728a3f30e0d", "bridge": "br-int", "label": "tempest-TestShelveInstance-377165265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce85700824de42378524bbe3b028cc43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c71e1bc-cb", "ovs_interfaceid": "7c71e1bc-cb13-4391-aae1-93f292af5eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_vif [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c71e1bc-cb, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:45:13 user nova-compute[72447]: INFO os_vif [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:db:7f,bridge_name='br-int',has_traffic_filtering=True,id=7c71e1bc-cb13-4391-aae1-93f292af5eaa,network=Network(07c5d950-ba0f-4b71-935f-9728a3f30e0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c71e1bc-cb')
Jul 31 12:45:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsUmHgXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:45:13 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47bd4d8-4774-4c6d-9ab8-d790fca015d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[151c46ce-3579-4301-9d4f-d88971182613]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 (non-flash)
Jul 31 12:45:13 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 (non-flash)
Jul 31 12:45:13 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f066858c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b2aa25-b140-477d-bebc-ba65e28a0e98]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff9ebd9-e398-4fd8-9ec8-b45a57243679]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[92230aec-f980-471f-bed9-c7c168ac3c6f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6242a1d-23ff-4ba6-9d27-a99a012056ab]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3ebb99', '/dev/disk/by-id/scsi-1SCST_BIO3ebb99-aadbddaa423b6e5c', '/dev/disk/by-id/scsi-26161646264646161') {{(pid=83492) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ecce26-1a5e-4dae-ac83-4d74e5838cae]: (4, None) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[77102a9d-b9c8-41ea-8b6e-a112f0ddc1b0]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c358fe-3d7b-4e57-a364-e141e5e7d81d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260]
Jul 31 12:45:13 user nova-compute[72447]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7, portal: 172.16.0.220,3260] successful.
Jul 31 12:45:13 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42560baf-28a9-41c7-8308-2df68f8f8ba7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb85c219-1fa0-4a59-808d-cd5618cfd81c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] <== disconnect_volume: return (280ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:45:13 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Deleting instance files /opt/stack/data/nova/instances/61fd2bb6-953a-4803-81bd-d1f03c1bc8a4_del
Jul 31 12:45:13 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Deletion of /opt/stack/data/nova/instances/61fd2bb6-953a-4803-81bd-d1f03c1bc8a4_del complete
Jul 31 12:45:13 user nova-compute[72447]: INFO nova.compute.manager [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Took 1.12 seconds to destroy the instance on the hypervisor.
Jul 31 12:45:13 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:45:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-0e7f7f58-1ff6-4e87-a403-5a5b6b27cb68 req-96ca449e-61db-4a28-95ad-130da76b30d5 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-vif-deleted-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:45:13 user nova-compute[72447]: INFO nova.compute.manager [req-0e7f7f58-1ff6-4e87-a403-5a5b6b27cb68 req-96ca449e-61db-4a28-95ad-130da76b30d5 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Neutron deleted interface 7c71e1bc-cb13-4391-aae1-93f292af5eaa; detaching it from the instance and deleting it from the info cache
Jul 31 12:45:13 user nova-compute[72447]: DEBUG nova.network.neutron [req-0e7f7f58-1ff6-4e87-a403-5a5b6b27cb68 req-96ca449e-61db-4a28-95ad-130da76b30d5 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:45:13 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Took 0.50 seconds to deallocate network for instance.
Jul 31 12:45:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-0e7f7f58-1ff6-4e87-a403-5a5b6b27cb68 req-96ca449e-61db-4a28-95ad-130da76b30d5 service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Detach interface failed, port_id=7c71e1bc-cb13-4391-aae1-93f292af5eaa, reason: Instance 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 could not be found. {{(pid=72447) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 12:45:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-2141efde-7127-445c-b9a3-4da2fdcc17ec req-c162a7e6-be35-46d7-94da-c2b7b9ce51fe service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received event network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:45:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2141efde-7127-445c-b9a3-4da2fdcc17ec req-c162a7e6-be35-46d7-94da-c2b7b9ce51fe service nova] Acquiring lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:45:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2141efde-7127-445c-b9a3-4da2fdcc17ec req-c162a7e6-be35-46d7-94da-c2b7b9ce51fe service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:45:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2141efde-7127-445c-b9a3-4da2fdcc17ec req-c162a7e6-be35-46d7-94da-c2b7b9ce51fe service nova] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:45:14 user nova-compute[72447]: DEBUG nova.compute.manager [req-2141efde-7127-445c-b9a3-4da2fdcc17ec req-c162a7e6-be35-46d7-94da-c2b7b9ce51fe service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] No waiting events found dispatching network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:45:14 user nova-compute[72447]: WARNING nova.compute.manager [req-2141efde-7127-445c-b9a3-4da2fdcc17ec req-c162a7e6-be35-46d7-94da-c2b7b9ce51fe service nova] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Received unexpected event network-vif-plugged-7c71e1bc-cb13-4391-aae1-93f292af5eaa for instance with vm_state active and task_state deleting.
Jul 31 12:45:14 user nova-compute[72447]: INFO nova.compute.manager [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Took 0.69 seconds to detach 1 volumes for instance.
Jul 31 12:45:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Deleting volume: 42560baf-28a9-41c7-8308-2df68f8f8ba7 {{(pid=72447) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 12:45:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:45:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:45:14 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:45:14 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:45:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:45:14 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Deleted allocations for instance 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4
Jul 31 12:45:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-f8f6825a-b762-4710-bd15-9bb3da7196d3 tempest-TestShelveInstance-158902571 tempest-TestShelveInstance-158902571-project-member] Lock "61fd2bb6-953a-4803-81bd-d1f03c1bc8a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.882s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:45:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:16 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:45:16 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:45:16 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:45:16 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:45:16 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:45:16 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:45:16 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:45:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:45:20 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:45:21 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:45:21 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:45:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=25.167552947998047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:45:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:45:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:45:27 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:45:28 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690807513.0795047, 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:45:28 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] VM Stopped (Lifecycle Event)
Jul 31 12:45:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-51570eb3-e37b-4baf-b780-c5fe0cc0bae9 None None] [instance: 61fd2bb6-953a-4803-81bd-d1f03c1bc8a4] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:45:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:45:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:45:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:45:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:45:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:29 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:45:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:45:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:45:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:45:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:45:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:45:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:45:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:45:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:45:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:45:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:45:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:16 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:46:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:46:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:46:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:46:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:46:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:46:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:46:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:46:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:21 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:46:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:46:23 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:46:23 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:46:23 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.165573120117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:46:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:46:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:46:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:46:30 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:46:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:46:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:46:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:46:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:46:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:46:34 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:46:34 user nova-compute[72447]: INFO nova.compute.claims [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Claim successful on node user
Jul 31 12:46:35 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:46:35 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:46:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:46:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:46:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:46:35 user nova-compute[72447]: DEBUG nova.network.neutron [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:46:35 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:46:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:46:35 user nova-compute[72447]: INFO nova.virt.block_device [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Booting with volume snapshot fe34aef3-addc-4916-b7cc-6988c80f05d5 at /dev/vda
Jul 31 12:46:35 user nova-compute[72447]: DEBUG nova.policy [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10213ac072b24a899a4cc1403a601edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1be744ad5e14a4a8d1ca055e023e2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:46:35 user nova-compute[72447]: DEBUG nova.network.neutron [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Successfully created port: 6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:46:36 user nova-compute[72447]: DEBUG nova.network.neutron [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Successfully updated port: 6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:46:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "refresh_cache-e87cfc43-5581-461d-a3a5-dc2ea8c2b337" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:46:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquired lock "refresh_cache-e87cfc43-5581-461d-a3a5-dc2ea8c2b337" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:46:36 user nova-compute[72447]: DEBUG nova.network.neutron [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:46:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-1407aa64-b4b9-427b-9ce9-f6d833a530d4 req-0930001f-958a-4cea-b627-40158e641fab service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Received event network-changed-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:46:36 user nova-compute[72447]: DEBUG nova.compute.manager [req-1407aa64-b4b9-427b-9ce9-f6d833a530d4 req-0930001f-958a-4cea-b627-40158e641fab service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Refreshing instance network info cache due to event network-changed-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:46:36 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1407aa64-b4b9-427b-9ce9-f6d833a530d4 req-0930001f-958a-4cea-b627-40158e641fab service nova] Acquiring lock "refresh_cache-e87cfc43-5581-461d-a3a5-dc2ea8c2b337" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:46:36 user nova-compute[72447]: DEBUG nova.network.neutron [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:46:37 user nova-compute[72447]: DEBUG nova.network.neutron [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Updating instance_info_cache with network_info: [{"id": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "address": "fa:16:3e:da:9c:1f", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7184dc-f8", "ovs_interfaceid": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:46:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Releasing lock "refresh_cache-e87cfc43-5581-461d-a3a5-dc2ea8c2b337" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:46:37 user nova-compute[72447]: DEBUG nova.compute.manager [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Instance network_info: |[{"id": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "address": "fa:16:3e:da:9c:1f", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7184dc-f8", "ovs_interfaceid": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:46:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1407aa64-b4b9-427b-9ce9-f6d833a530d4 req-0930001f-958a-4cea-b627-40158e641fab service nova] Acquired lock "refresh_cache-e87cfc43-5581-461d-a3a5-dc2ea8c2b337" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:46:37 user nova-compute[72447]: DEBUG nova.network.neutron [req-1407aa64-b4b9-427b-9ce9-f6d833a530d4 req-0930001f-958a-4cea-b627-40158e641fab service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Refreshing network info cache for port 6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:46:37 user nova-compute[72447]: DEBUG nova.network.neutron [req-1407aa64-b4b9-427b-9ce9-f6d833a530d4 req-0930001f-958a-4cea-b627-40158e641fab service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Updated VIF entry in instance network info cache for port 6d7184dc-f8df-4df7-9f24-81fd33b3f9ed. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:46:37 user nova-compute[72447]: DEBUG nova.network.neutron [req-1407aa64-b4b9-427b-9ce9-f6d833a530d4 req-0930001f-958a-4cea-b627-40158e641fab service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Updating instance_info_cache with network_info: [{"id": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "address": "fa:16:3e:da:9c:1f", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7184dc-f8", "ovs_interfaceid": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:46:37 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1407aa64-b4b9-427b-9ce9-f6d833a530d4 req-0930001f-958a-4cea-b627-40158e641fab service nova] Releasing lock "refresh_cache-e87cfc43-5581-461d-a3a5-dc2ea8c2b337" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:46:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:46:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:46:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:46:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:46:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:46:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:46:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:46:39 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:46:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Verify base images {{(pid=72447) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 31 12:46:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72447) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 31 12:46:39 user nova-compute[72447]: WARNING nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c
Jul 31 12:46:39 user nova-compute[72447]: WARNING nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c
Jul 31 12:46:39 user nova-compute[72447]: WARNING nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e
Jul 31 12:46:39 user nova-compute[72447]: WARNING nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20
Jul 31 12:46:39 user nova-compute[72447]: WARNING nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632
Jul 31 12:46:39 user nova-compute[72447]: WARNING nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e
Jul 31 12:46:39 user nova-compute[72447]: WARNING nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b
Jul 31 12:46:39 user nova-compute[72447]: WARNING nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818
Jul 31 12:46:39 user nova-compute[72447]: WARNING nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038
Jul 31 12:46:39 user nova-compute[72447]: WARNING nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322
Jul 31 12:46:39 user nova-compute[72447]: INFO nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Removable base files: /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20 /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632 /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818 /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038 /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322
Jul 31 12:46:39 user nova-compute[72447]: INFO nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/01fb41aad0e519740ef4b71d70f4ab2ad5ffa14c
Jul 31 12:46:39 user nova-compute[72447]: INFO nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/de2f30067631a9a63bc4a295415d89adb1b4831c
Jul 31 12:46:39 user nova-compute[72447]: INFO nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/53b1abe6c13ef1c1cef022d1e740ba5fba14f64e
Jul 31 12:46:39 user nova-compute[72447]: INFO nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/73afd3a2c0a95240195a9439e42829f73da89d20
Jul 31 12:46:39 user nova-compute[72447]: INFO nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ae7d4d240f015e711a223edff06f40af9833e632
Jul 31 12:46:39 user nova-compute[72447]: INFO nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9c2e1053c2d73a50b0408acc2842a2fc3380214e
Jul 31 12:46:39 user nova-compute[72447]: INFO nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/784ac8e352a7fea941e6af41c7bdeca96045d00b
Jul 31 12:46:39 user nova-compute[72447]: INFO nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c796b29ef0ffe5d92001adcab930a84d6f474818
Jul 31 12:46:39 user nova-compute[72447]: INFO nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/711ccdba28117229f27dcaf938dd17031690f038
Jul 31 12:46:39 user nova-compute[72447]: INFO nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d38eb98fd387443f1fbc5cfb92971504072d322
Jul 31 12:46:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Verification complete {{(pid=72447) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 31 12:46:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Verify swap images {{(pid=72447) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 31 12:46:39 user nova-compute[72447]: DEBUG nova.virt.libvirt.imagecache [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Verify ephemeral images {{(pid=72447) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG os_brick.utils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cce05e6-e81d-4645-8dcc-77613296f4ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[030123fa-2af7-43ff-9164-bc83ad5794f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d736f8-f844-4093-8951-2116d74d6870]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e64526-4f84-46ab-8b12-f444c0f04b3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:46:40 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:46:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd1726a-68f8-47aa-9180-df4e315f9212]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG os_brick.utils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:46:40 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Updating existing volume attachment record: 2c404489-3ae4-4745-8dcf-9556a4d78325 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:46:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.compute.manager [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:46:48 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Creating image(s)
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Ensure instance console log exists: /opt/stack/data/nova/instances/e87cfc43-5581-461d-a3a5-dc2ea8c2b337/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Start _get_guest_xml network_info=[{"id": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "address": "fa:16:3e:da:9c:1f", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7184dc-f8", "ovs_interfaceid": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '2c404489-3ae4-4745-8dcf-9556a4d78325', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snXeKBAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e87cfc43-5581-461d-a3a5-dc2ea8c2b337', 'attached_at': '', 'detached_at': '', 'volume_id': 'd66225ed-5c4b-4633-a831-82c22aaed9e0', 'serial': 'd66225ed-5c4b-4633-a831-82c22aaed9e0'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:46:48 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:46:48 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snXeKBAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:46:48 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:46:48 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:46:48 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[db60aef2-51e2-475b-8e19-329ea37a054f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:46:48 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b250238-c753-41f6-9c70-ba44889fd1a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0] added
Jul 31 12:46:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b06a5d-e9ff-4fa8-ab27-0c059f706360]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f421df8-cf72-4f71-8d8b-a9261af8c67b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snXeKBAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snXeKBAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ef6544-e2b8-4b0c-adf6-fc0c8ed50ae0]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'snXeKBAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94e29d8-f505-4269-aaf1-3d3bc3965e0c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0d3a60-387d-482c-8aac-70bfc863790a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:46:48 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:46:48 user nova-compute[72447]:  {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:46:48 user nova-compute[72447]: WARNING os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 12:46:48 user nova-compute[72447]: 
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2bee8b-be69-48e5-a451-d6ce7be5f18a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0, portal: 172.16.0.220,3260]
Jul 31 12:46:48 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0, portal: 172.16.0.220,3260] successful.
Jul 31 12:46:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9a525b-09be-4583-b0b8-e868d90ea8d1]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1888315-6cda-4705-8698-feac89855060]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 (non-flash)
Jul 31 12:46:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 (non-flash)
Jul 31 12:46:48 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d94ec3-31d6-45f7-ba02-0fa0151370c4]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:46:48 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snXeKBAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23764646635376166', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764646635376166', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-516151732',display_name='tempest-TestVolumeBootPattern-server-516151732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-516151732',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-kh19o1r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:46:35Z,user_data=None,user_id='10213ac072b24a899a4cc1403a601edf',uuid=e87cfc43-5581-461d-a3a5-dc2ea8c2b337,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "address": "fa:16:3e:da:9c:1f", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7184dc-f8", "ovs_interfaceid": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "address": "fa:16:3e:da:9c:1f", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7184dc-f8", "ovs_interfaceid": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:9c:1f,bridge_name='br-int',has_traffic_filtering=True,id=6d7184dc-f8df-4df7-9f24-81fd33b3f9ed,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7184dc-f8') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG nova.objects.instance [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lazy-loading 'pci_devices' on Instance uuid e87cfc43-5581-461d-a3a5-dc2ea8c2b337 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:46:49 user nova-compute[72447]:   <uuid>e87cfc43-5581-461d-a3a5-dc2ea8c2b337</uuid>
Jul 31 12:46:49 user nova-compute[72447]:   <name>instance-0000002e</name>
Jul 31 12:46:49 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:46:49 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:46:49 user nova-compute[72447]:   <metadata>
Jul 31 12:46:49 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:46:49 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:46:49 user nova-compute[72447]:       <nova:name>tempest-TestVolumeBootPattern-server-516151732</nova:name>
Jul 31 12:46:49 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:46:48</nova:creationTime>
Jul 31 12:46:49 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:46:49 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:46:49 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:46:49 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:46:49 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:46:49 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:46:49 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:46:49 user nova-compute[72447]:       <nova:owner>
Jul 31 12:46:49 user nova-compute[72447]:         <nova:user uuid="10213ac072b24a899a4cc1403a601edf">tempest-TestVolumeBootPattern-37536115-project-member</nova:user>
Jul 31 12:46:49 user nova-compute[72447]:         <nova:project uuid="e1be744ad5e14a4a8d1ca055e023e2fb">tempest-TestVolumeBootPattern-37536115</nova:project>
Jul 31 12:46:49 user nova-compute[72447]:       </nova:owner>
Jul 31 12:46:49 user nova-compute[72447]:       <nova:ports>
Jul 31 12:46:49 user nova-compute[72447]:         <nova:port uuid="6d7184dc-f8df-4df7-9f24-81fd33b3f9ed">
Jul 31 12:46:49 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:46:49 user nova-compute[72447]:         </nova:port>
Jul 31 12:46:49 user nova-compute[72447]:       </nova:ports>
Jul 31 12:46:49 user nova-compute[72447]:     </nova:instance>
Jul 31 12:46:49 user nova-compute[72447]:   </metadata>
Jul 31 12:46:49 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:46:49 user nova-compute[72447]:     <system>
Jul 31 12:46:49 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:46:49 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:46:49 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:46:49 user nova-compute[72447]:       <entry name="serial">e87cfc43-5581-461d-a3a5-dc2ea8c2b337</entry>
Jul 31 12:46:49 user nova-compute[72447]:       <entry name="uuid">e87cfc43-5581-461d-a3a5-dc2ea8c2b337</entry>
Jul 31 12:46:49 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:46:49 user nova-compute[72447]:     </system>
Jul 31 12:46:49 user nova-compute[72447]:   </sysinfo>
Jul 31 12:46:49 user nova-compute[72447]:   <os>
Jul 31 12:46:49 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:46:49 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:46:49 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:46:49 user nova-compute[72447]:   </os>
Jul 31 12:46:49 user nova-compute[72447]:   <features>
Jul 31 12:46:49 user nova-compute[72447]:     <acpi/>
Jul 31 12:46:49 user nova-compute[72447]:     <apic/>
Jul 31 12:46:49 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:46:49 user nova-compute[72447]:   </features>
Jul 31 12:46:49 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:46:49 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:46:49 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:46:49 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:46:49 user nova-compute[72447]:   </clock>
Jul 31 12:46:49 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:46:49 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:46:49 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:46:49 user nova-compute[72447]:   </cpu>
Jul 31 12:46:49 user nova-compute[72447]:   <devices>
Jul 31 12:46:49 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:46:49 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:46:49 user nova-compute[72447]:       <source dev="/dev/sdb"/>
Jul 31 12:46:49 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:46:49 user nova-compute[72447]:       <serial>d66225ed-5c4b-4633-a831-82c22aaed9e0</serial>
Jul 31 12:46:49 user nova-compute[72447]:     </disk>
Jul 31 12:46:49 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:46:49 user nova-compute[72447]:       <mac address="fa:16:3e:da:9c:1f"/>
Jul 31 12:46:49 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:46:49 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:46:49 user nova-compute[72447]:       <target dev="tap6d7184dc-f8"/>
Jul 31 12:46:49 user nova-compute[72447]:     </interface>
Jul 31 12:46:49 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:46:49 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/e87cfc43-5581-461d-a3a5-dc2ea8c2b337/console.log" append="off"/>
Jul 31 12:46:49 user nova-compute[72447]:     </serial>
Jul 31 12:46:49 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:46:49 user nova-compute[72447]:     <video>
Jul 31 12:46:49 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:46:49 user nova-compute[72447]:     </video>
Jul 31 12:46:49 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:46:49 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:46:49 user nova-compute[72447]:     </rng>
Jul 31 12:46:49 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:46:49 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:46:49 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:46:49 user nova-compute[72447]:     </memballoon>
Jul 31 12:46:49 user nova-compute[72447]:   </devices>
Jul 31 12:46:49 user nova-compute[72447]: </domain>
Jul 31 12:46:49 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-516151732',display_name='tempest-TestVolumeBootPattern-server-516151732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-516151732',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-kh19o1r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:46:35Z,user_data=None,user_id='10213ac072b24a899a4cc1403a601edf',uuid=e87cfc43-5581-461d-a3a5-dc2ea8c2b337,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "address": "fa:16:3e:da:9c:1f", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7184dc-f8", "ovs_interfaceid": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "address": "fa:16:3e:da:9c:1f", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7184dc-f8", "ovs_interfaceid": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:9c:1f,bridge_name='br-int',has_traffic_filtering=True,id=6d7184dc-f8df-4df7-9f24-81fd33b3f9ed,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7184dc-f8') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG os_vif [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:9c:1f,bridge_name='br-int',has_traffic_filtering=True,id=6d7184dc-f8df-4df7-9f24-81fd33b3f9ed,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7184dc-f8') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d7184dc-f8, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d7184dc-f8, col_values=(('external_ids', {'iface-id': '6d7184dc-f8df-4df7-9f24-81fd33b3f9ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:9c:1f', 'vm-uuid': 'e87cfc43-5581-461d-a3a5-dc2ea8c2b337'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:49 user nova-compute[72447]: INFO os_vif [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:9c:1f,bridge_name='br-int',has_traffic_filtering=True,id=6d7184dc-f8df-4df7-9f24-81fd33b3f9ed,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7184dc-f8')
Jul 31 12:46:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:46:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] No VIF found with MAC fa:16:3e:da:9c:1f, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:46:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-6c26bd1d-efcb-41f4-abbd-f8b84baf1b88 req-e5623d3f-5513-4dee-ade7-55905e1618df service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Received event network-vif-plugged-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:46:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6c26bd1d-efcb-41f4-abbd-f8b84baf1b88 req-e5623d3f-5513-4dee-ade7-55905e1618df service nova] Acquiring lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:46:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6c26bd1d-efcb-41f4-abbd-f8b84baf1b88 req-e5623d3f-5513-4dee-ade7-55905e1618df service nova] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:46:50 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6c26bd1d-efcb-41f4-abbd-f8b84baf1b88 req-e5623d3f-5513-4dee-ade7-55905e1618df service nova] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:46:50 user nova-compute[72447]: DEBUG nova.compute.manager [req-6c26bd1d-efcb-41f4-abbd-f8b84baf1b88 req-e5623d3f-5513-4dee-ade7-55905e1618df service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] No waiting events found dispatching network-vif-plugged-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:46:50 user nova-compute[72447]: WARNING nova.compute.manager [req-6c26bd1d-efcb-41f4-abbd-f8b84baf1b88 req-e5623d3f-5513-4dee-ade7-55905e1618df service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Received unexpected event network-vif-plugged-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed for instance with vm_state building and task_state spawning.
Jul 31 12:46:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807612.7269735, e87cfc43-5581-461d-a3a5-dc2ea8c2b337 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:46:52 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] VM Resumed (Lifecycle Event)
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:46:52 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Instance spawned successfully.
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:46:52 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807612.7286782, e87cfc43-5581-461d-a3a5-dc2ea8c2b337 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:46:52 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] VM Started (Lifecycle Event)
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:46:52 user nova-compute[72447]: INFO nova.compute.manager [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Took 4.85 seconds to spawn the instance on the hypervisor.
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.compute.manager [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:46:52 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:46:52 user nova-compute[72447]: INFO nova.compute.manager [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Took 18.05 seconds to build instance.
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-13bb29cf-f1d9-4fb9-868f-2850afc01bd8 req-0f69888f-0eb2-4ab5-866b-a9a12fb4d121 service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Received event network-vif-plugged-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-13bb29cf-f1d9-4fb9-868f-2850afc01bd8 req-0f69888f-0eb2-4ab5-866b-a9a12fb4d121 service nova] Acquiring lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-13bb29cf-f1d9-4fb9-868f-2850afc01bd8 req-0f69888f-0eb2-4ab5-866b-a9a12fb4d121 service nova] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-13bb29cf-f1d9-4fb9-868f-2850afc01bd8 req-0f69888f-0eb2-4ab5-866b-a9a12fb4d121 service nova] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:46:52 user nova-compute[72447]: DEBUG nova.compute.manager [req-13bb29cf-f1d9-4fb9-868f-2850afc01bd8 req-0f69888f-0eb2-4ab5-866b-a9a12fb4d121 service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] No waiting events found dispatching network-vif-plugged-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:46:52 user nova-compute[72447]: WARNING nova.compute.manager [req-13bb29cf-f1d9-4fb9-868f-2850afc01bd8 req-0f69888f-0eb2-4ab5-866b-a9a12fb4d121 service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Received unexpected event network-vif-plugged-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed for instance with vm_state active and task_state None.
Jul 31 12:46:52 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-94336a54-1694-4313-9457-f426382bf8ac tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.138s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:46:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:46:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:47:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:47:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:47:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:47:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:47:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:15 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:16 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:47:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:47:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-e87cfc43-5581-461d-a3a5-dc2ea8c2b337" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:47:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-e87cfc43-5581-461d-a3a5-dc2ea8c2b337" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:47:17 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:47:17 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid e87cfc43-5581-461d-a3a5-dc2ea8c2b337 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:47:17 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Updating instance_info_cache with network_info: [{"id": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "address": "fa:16:3e:da:9c:1f", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7184dc-f8", "ovs_interfaceid": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:47:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-e87cfc43-5581-461d-a3a5-dc2ea8c2b337" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:47:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:47:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:47:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:21 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:21 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72447) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 12:47:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:47:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:47:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:47:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:47:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:47:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:47:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:47:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8782MB free_disk=25.16356658935547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:47:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:47:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:47:26 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance e87cfc43-5581-461d-a3a5-dc2ea8c2b337 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:47:26 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:47:26 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:47:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing inventories for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 12:47:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating ProviderTree inventory for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 12:47:26 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 12:47:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing aggregate associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, aggregates: None {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 12:47:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing trait associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 12:47:26 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:47:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:47:26 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:47:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:47:27 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:29 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:32 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:47:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:47:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:47:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:47:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:47:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:47:41 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 12:47:41 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] There are 0 instances to clean {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 12:47:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:47:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:47:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:47:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:47:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:47:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:47:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:47:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:47:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:47:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:47:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:47:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:48:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:48:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:48:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:48:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:48:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:48:16 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:48:18 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:48:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:48:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:48:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-e87cfc43-5581-461d-a3a5-dc2ea8c2b337" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:48:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-e87cfc43-5581-461d-a3a5-dc2ea8c2b337" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:48:18 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:48:18 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid e87cfc43-5581-461d-a3a5-dc2ea8c2b337 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:48:18 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Updating instance_info_cache with network_info: [{"id": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "address": "fa:16:3e:da:9c:1f", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7184dc-f8", "ovs_interfaceid": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:48:18 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-e87cfc43-5581-461d-a3a5-dc2ea8c2b337" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:48:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:48:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:48:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:48:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:48:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:48:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:21 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:48:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:48:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:48:23 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:48:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:48:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:48:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:48:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=25.162948608398438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:48:25 user nova-compute[72447]: INFO nova.compute.manager [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Terminating instance
Jul 31 12:48:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance e87cfc43-5581-461d-a3a5-dc2ea8c2b337 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:48:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-9c7cdc5f-9587-4fa2-b79c-ccfc7162fd5b req-cc8f8372-5050-4b0b-b14d-6bce3eff20f9 service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Received event network-vif-unplugged-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9c7cdc5f-9587-4fa2-b79c-ccfc7162fd5b req-cc8f8372-5050-4b0b-b14d-6bce3eff20f9 service nova] Acquiring lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9c7cdc5f-9587-4fa2-b79c-ccfc7162fd5b req-cc8f8372-5050-4b0b-b14d-6bce3eff20f9 service nova] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-9c7cdc5f-9587-4fa2-b79c-ccfc7162fd5b req-cc8f8372-5050-4b0b-b14d-6bce3eff20f9 service nova] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-9c7cdc5f-9587-4fa2-b79c-ccfc7162fd5b req-cc8f8372-5050-4b0b-b14d-6bce3eff20f9 service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] No waiting events found dispatching network-vif-unplugged-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG nova.compute.manager [req-9c7cdc5f-9587-4fa2-b79c-ccfc7162fd5b req-cc8f8372-5050-4b0b-b14d-6bce3eff20f9 service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Received event network-vif-unplugged-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:26 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Instance destroyed successfully.
Jul 31 12:48:26 user nova-compute[72447]: DEBUG nova.objects.instance [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lazy-loading 'resources' on Instance uuid e87cfc43-5581-461d-a3a5-dc2ea8c2b337 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-516151732',display_name='tempest-TestVolumeBootPattern-server-516151732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-516151732',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-kh19o1r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:46:53Z,user_data=None,user_id='10213ac072b24a899a4cc1403a601edf',uuid=e87cfc43-5581-461d-a3a5-dc2ea8c2b337,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "address": "fa:16:3e:da:9c:1f", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7184dc-f8", "ovs_interfaceid": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "address": "fa:16:3e:da:9c:1f", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d7184dc-f8", "ovs_interfaceid": "6d7184dc-f8df-4df7-9f24-81fd33b3f9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:9c:1f,bridge_name='br-int',has_traffic_filtering=True,id=6d7184dc-f8df-4df7-9f24-81fd33b3f9ed,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7184dc-f8') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_vif [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:9c:1f,bridge_name='br-int',has_traffic_filtering=True,id=6d7184dc-f8df-4df7-9f24-81fd33b3f9ed,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7184dc-f8') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d7184dc-f8, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:48:26 user nova-compute[72447]: INFO os_vif [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:9c:1f,bridge_name='br-int',has_traffic_filtering=True,id=6d7184dc-f8df-4df7-9f24-81fd33b3f9ed,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d7184dc-f8')
Jul 31 12:48:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snXeKBAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:48:26 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a17925-1845-443d-9779-88497a415741]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9edbc0-79af-4ef2-8e06-a8d235517263]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 (non-flash)
Jul 31 12:48:26 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 (non-flash)
Jul 31 12:48:26 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06683f0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[978e098f-9ce6-4114-af5e-e4f4ee26d8ce]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfc153a-f4c1-4e39-8548-897e03e22857]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2395b60e-4cff-4493-998b-f90b2af5e3fe]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[909c2ef0-35e7-48ec-9b0b-89ae672c0f86]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e0e5d7-dcf1-4c73-be57-c9c17f085b83]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[384a84d6-147b-4b27-9e9a-de3243e8c751]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0, portal: 172.16.0.220,3260]
Jul 31 12:48:26 user nova-compute[72447]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0, portal: 172.16.0.220,3260] successful.
Jul 31 12:48:26 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66225ed-5c4b-4633-a831-82c22aaed9e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[412db4a5-2103-4281-938c-51f7d888f827]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== disconnect_volume: return (268ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:48:26 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Deleting instance files /opt/stack/data/nova/instances/e87cfc43-5581-461d-a3a5-dc2ea8c2b337_del
Jul 31 12:48:26 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Deletion of /opt/stack/data/nova/instances/e87cfc43-5581-461d-a3a5-dc2ea8c2b337_del complete
Jul 31 12:48:26 user nova-compute[72447]: INFO nova.compute.manager [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:48:26 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:48:27 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:48:27 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Took 0.48 seconds to deallocate network for instance.
Jul 31 12:48:28 user nova-compute[72447]: INFO nova.compute.manager [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Took 0.70 seconds to detach 1 volumes for instance.
Jul 31 12:48:28 user nova-compute[72447]: DEBUG nova.compute.manager [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Deleting volume: d66225ed-5c4b-4633-a831-82c22aaed9e0 {{(pid=72447) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 12:48:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-e746dfa0-2de9-4360-b59c-8a49de39c563 req-18929757-1d8c-4ca3-b9fa-363d544a2b4a service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Received event network-vif-plugged-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:48:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e746dfa0-2de9-4360-b59c-8a49de39c563 req-18929757-1d8c-4ca3-b9fa-363d544a2b4a service nova] Acquiring lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:48:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e746dfa0-2de9-4360-b59c-8a49de39c563 req-18929757-1d8c-4ca3-b9fa-363d544a2b4a service nova] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:48:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-e746dfa0-2de9-4360-b59c-8a49de39c563 req-18929757-1d8c-4ca3-b9fa-363d544a2b4a service nova] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:48:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-e746dfa0-2de9-4360-b59c-8a49de39c563 req-18929757-1d8c-4ca3-b9fa-363d544a2b4a service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] No waiting events found dispatching network-vif-plugged-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:48:28 user nova-compute[72447]: WARNING nova.compute.manager [req-e746dfa0-2de9-4360-b59c-8a49de39c563 req-18929757-1d8c-4ca3-b9fa-363d544a2b4a service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Received unexpected event network-vif-plugged-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed for instance with vm_state active and task_state deleting.
Jul 31 12:48:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-e746dfa0-2de9-4360-b59c-8a49de39c563 req-18929757-1d8c-4ca3-b9fa-363d544a2b4a service nova] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Received event network-vif-deleted-6d7184dc-f8df-4df7-9f24-81fd33b3f9ed {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:48:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:48:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:48:28 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:48:28 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:48:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:48:28 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Deleted allocations for instance e87cfc43-5581-461d-a3a5-dc2ea8c2b337
Jul 31 12:48:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-955b9d60-d958-4bf0-acdb-44929656e357 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "e87cfc43-5581-461d-a3a5-dc2ea8c2b337" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.727s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:48:30 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:48:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:33 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:48:35 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:48:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:48:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:48:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:48:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:48:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:48:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:41 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690807706.5126839, e87cfc43-5581-461d-a3a5-dc2ea8c2b337 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:48:41 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] VM Stopped (Lifecycle Event)
Jul 31 12:48:41 user nova-compute[72447]: DEBUG nova.compute.manager [None req-a8548a9f-4a6a-4590-9c0e-9e42cb95345d None None] [instance: e87cfc43-5581-461d-a3a5-dc2ea8c2b337] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:48:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:48:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:48:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:48:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:49:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:49:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:49:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:49:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:49:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:49:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:49:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:49:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:49:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:49:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:49:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:49:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:49:18 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:49:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:49:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:49:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:49:21 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:49:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:49:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:23 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:49:23 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:49:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:49:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:49:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:49:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:49:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:49:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:49:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:49:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=25.15407943725586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:49:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:49:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:49:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:49:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:49:25 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:49:25 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:49:26 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:49:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:49:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:49:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:49:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:49:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:49:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:26 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:49:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:49:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "c0060792-4093-43ab-af7c-610c42f72dca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "c0060792-4093-43ab-af7c-610c42f72dca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG nova.compute.manager [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:49:32 user nova-compute[72447]: INFO nova.compute.claims [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Claim successful on node user
Jul 31 12:49:32 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.176s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG nova.compute.manager [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG nova.compute.manager [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG nova.network.neutron [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:49:32 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:49:32 user nova-compute[72447]: DEBUG nova.compute.manager [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:49:32 user nova-compute[72447]: INFO nova.virt.block_device [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Booting with volume bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c at /dev/vda
Jul 31 12:49:32 user nova-compute[72447]: DEBUG os_brick.utils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG nova.policy [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10213ac072b24a899a4cc1403a601edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1be744ad5e14a4a8d1ca055e023e2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f084cdd3-a7e2-4c01-9aea-cad5dbf8a294]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ffc779-078e-4499-8bb4-b5cc58311595]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3163801f-0aea-446b-ad89-bd650daba5a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17681fb-10f1-4181-a113-90576184186a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:49:32 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:49:32 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[79784a57-833f-427f-bdb0-74dcfeb129f1]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG os_brick.utils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:49:32 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updating existing volume attachment record: 3dda6930-21a6-4a23-883c-e807c39a8521 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:49:33 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:49:33 user nova-compute[72447]: DEBUG nova.network.neutron [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Successfully created port: 85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG nova.network.neutron [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Successfully updated port: 85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquired lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG nova.network.neutron [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-68f711b4-3553-4109-98eb-08c40b62cba3 req-1165de43-9895-41d7-a1ef-4da67042d597 service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Received event network-changed-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG nova.compute.manager [req-68f711b4-3553-4109-98eb-08c40b62cba3 req-1165de43-9895-41d7-a1ef-4da67042d597 service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Refreshing instance network info cache due to event network-changed-85ea1c1b-efa0-4179-97a6-b2160ac4ae30. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-68f711b4-3553-4109-98eb-08c40b62cba3 req-1165de43-9895-41d7-a1ef-4da67042d597 service nova] Acquiring lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG nova.network.neutron [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG nova.network.neutron [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updating instance_info_cache with network_info: [{"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Releasing lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG nova.compute.manager [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Instance network_info: |[{"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-68f711b4-3553-4109-98eb-08c40b62cba3 req-1165de43-9895-41d7-a1ef-4da67042d597 service nova] Acquired lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:49:34 user nova-compute[72447]: DEBUG nova.network.neutron [req-68f711b4-3553-4109-98eb-08c40b62cba3 req-1165de43-9895-41d7-a1ef-4da67042d597 service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Refreshing network info cache for port 85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:49:35 user nova-compute[72447]: DEBUG nova.network.neutron [req-68f711b4-3553-4109-98eb-08c40b62cba3 req-1165de43-9895-41d7-a1ef-4da67042d597 service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updated VIF entry in instance network info cache for port 85ea1c1b-efa0-4179-97a6-b2160ac4ae30. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:49:35 user nova-compute[72447]: DEBUG nova.network.neutron [req-68f711b4-3553-4109-98eb-08c40b62cba3 req-1165de43-9895-41d7-a1ef-4da67042d597 service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updating instance_info_cache with network_info: [{"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:49:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-68f711b4-3553-4109-98eb-08c40b62cba3 req-1165de43-9895-41d7-a1ef-4da67042d597 service nova] Releasing lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:49:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.compute.manager [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:49:40 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Creating image(s)
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Ensure instance console log exists: /opt/stack/data/nova/instances/c0060792-4093-43ab-af7c-610c42f72dca/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Start _get_guest_xml network_info=[{"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '3dda6930-21a6-4a23-883c-e807c39a8521', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeIqJPxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0060792-4093-43ab-af7c-610c42f72dca', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c', 'serial': 'bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:49:40 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:49:40 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeIqJPxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:49:40 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:49:40 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:49:40 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba2b53c-c7ec-49e9-9e7c-f148061a2b64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:49:40 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83fb073-26d3-4d79-86a1-ebf97fa78fa5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c] added
Jul 31 12:49:40 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec1c9ad-ff34-443c-936f-93c1b4fe05bd]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e61b88-d95a-424d-a845-9f56b320e108]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VeIqJPxA {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VeIqJPxA" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e455a6-2ff2-48de-8df5-076d9a36607f]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VeIqJPxA'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfcef9e-e442-4d10-a0ac-9b88b4c249f6]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1861463b-9fb6-4078-a602-a44727fe62c3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:49:40 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:49:40 user nova-compute[72447]:  {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:49:40 user nova-compute[72447]: WARNING os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 12:49:40 user nova-compute[72447]: 
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee9ddf0-d7b9-400a-8f8c-b7e4c7554627]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c, portal: 172.16.0.220,3260]
Jul 31 12:49:40 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c, portal: 172.16.0.220,3260] successful.
Jul 31 12:49:40 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a222faeb-33d3-490a-a3d2-8cad4506bde6]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f8ada5-1ba6-444e-990a-a4a4913a0726]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)
Jul 31 12:49:40 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)
Jul 31 12:49:40 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6a4ee4-01b7-4d79-ab23-26b4e2cbe737]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:49:40 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeIqJPxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23162383862323735', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162383862323735', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-864886633',display_name='tempest-TestVolumeBootPattern-volume-backed-server-864886633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-864886633',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXAMk1AZ3kSCvFgmh4M1NrHqYZ765eJNN1i3GiPt9ZmhLGwGyejLPX8LhySC9UEV/GzwlZ6Yq8+C5ruz29w+cBWds/4j6gRfOUyNfyUb5OyYxQSlW8lPElErFBXVjef/A==',key_name='tempest-keypair-1016591083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-2bq8fiuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:49:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10213ac072b24a899a4cc1403a601edf',uuid=c0060792-4093-43ab-af7c-610c42f72dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:0d:f8,bridge_name='br-int',has_traffic_filtering=True,id=85ea1c1b-efa0-4179-97a6-b2160ac4ae30,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ea1c1b-ef') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG nova.objects.instance [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lazy-loading 'pci_devices' on Instance uuid c0060792-4093-43ab-af7c-610c42f72dca {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:49:41 user nova-compute[72447]:   <uuid>c0060792-4093-43ab-af7c-610c42f72dca</uuid>
Jul 31 12:49:41 user nova-compute[72447]:   <name>instance-0000002f</name>
Jul 31 12:49:41 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:49:41 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:49:41 user nova-compute[72447]:   <metadata>
Jul 31 12:49:41 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:49:41 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:49:41 user nova-compute[72447]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-864886633</nova:name>
Jul 31 12:49:41 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:49:40</nova:creationTime>
Jul 31 12:49:41 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:49:41 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:49:41 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:49:41 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:49:41 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:49:41 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:49:41 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:49:41 user nova-compute[72447]:       <nova:owner>
Jul 31 12:49:41 user nova-compute[72447]:         <nova:user uuid="10213ac072b24a899a4cc1403a601edf">tempest-TestVolumeBootPattern-37536115-project-member</nova:user>
Jul 31 12:49:41 user nova-compute[72447]:         <nova:project uuid="e1be744ad5e14a4a8d1ca055e023e2fb">tempest-TestVolumeBootPattern-37536115</nova:project>
Jul 31 12:49:41 user nova-compute[72447]:       </nova:owner>
Jul 31 12:49:41 user nova-compute[72447]:       <nova:ports>
Jul 31 12:49:41 user nova-compute[72447]:         <nova:port uuid="85ea1c1b-efa0-4179-97a6-b2160ac4ae30">
Jul 31 12:49:41 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 12:49:41 user nova-compute[72447]:         </nova:port>
Jul 31 12:49:41 user nova-compute[72447]:       </nova:ports>
Jul 31 12:49:41 user nova-compute[72447]:     </nova:instance>
Jul 31 12:49:41 user nova-compute[72447]:   </metadata>
Jul 31 12:49:41 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:49:41 user nova-compute[72447]:     <system>
Jul 31 12:49:41 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:49:41 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:49:41 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:49:41 user nova-compute[72447]:       <entry name="serial">c0060792-4093-43ab-af7c-610c42f72dca</entry>
Jul 31 12:49:41 user nova-compute[72447]:       <entry name="uuid">c0060792-4093-43ab-af7c-610c42f72dca</entry>
Jul 31 12:49:41 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:49:41 user nova-compute[72447]:     </system>
Jul 31 12:49:41 user nova-compute[72447]:   </sysinfo>
Jul 31 12:49:41 user nova-compute[72447]:   <os>
Jul 31 12:49:41 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:49:41 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:49:41 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:49:41 user nova-compute[72447]:   </os>
Jul 31 12:49:41 user nova-compute[72447]:   <features>
Jul 31 12:49:41 user nova-compute[72447]:     <acpi/>
Jul 31 12:49:41 user nova-compute[72447]:     <apic/>
Jul 31 12:49:41 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:49:41 user nova-compute[72447]:   </features>
Jul 31 12:49:41 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:49:41 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:49:41 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:49:41 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:49:41 user nova-compute[72447]:   </clock>
Jul 31 12:49:41 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:49:41 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:49:41 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:49:41 user nova-compute[72447]:   </cpu>
Jul 31 12:49:41 user nova-compute[72447]:   <devices>
Jul 31 12:49:41 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:49:41 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:49:41 user nova-compute[72447]:       <source dev="/dev/sdb"/>
Jul 31 12:49:41 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:49:41 user nova-compute[72447]:       <serial>bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c</serial>
Jul 31 12:49:41 user nova-compute[72447]:     </disk>
Jul 31 12:49:41 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:49:41 user nova-compute[72447]:       <mac address="fa:16:3e:27:0d:f8"/>
Jul 31 12:49:41 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:49:41 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:49:41 user nova-compute[72447]:       <target dev="tap85ea1c1b-ef"/>
Jul 31 12:49:41 user nova-compute[72447]:     </interface>
Jul 31 12:49:41 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:49:41 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/c0060792-4093-43ab-af7c-610c42f72dca/console.log" append="off"/>
Jul 31 12:49:41 user nova-compute[72447]:     </serial>
Jul 31 12:49:41 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:49:41 user nova-compute[72447]:     <video>
Jul 31 12:49:41 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:49:41 user nova-compute[72447]:     </video>
Jul 31 12:49:41 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:49:41 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:49:41 user nova-compute[72447]:     </rng>
Jul 31 12:49:41 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:49:41 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:49:41 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:49:41 user nova-compute[72447]:     </memballoon>
Jul 31 12:49:41 user nova-compute[72447]:   </devices>
Jul 31 12:49:41 user nova-compute[72447]: </domain>
Jul 31 12:49:41 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-864886633',display_name='tempest-TestVolumeBootPattern-volume-backed-server-864886633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-864886633',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXAMk1AZ3kSCvFgmh4M1NrHqYZ765eJNN1i3GiPt9ZmhLGwGyejLPX8LhySC9UEV/GzwlZ6Yq8+C5ruz29w+cBWds/4j6gRfOUyNfyUb5OyYxQSlW8lPElErFBXVjef/A==',key_name='tempest-keypair-1016591083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-2bq8fiuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:49:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10213ac072b24a899a4cc1403a601edf',uuid=c0060792-4093-43ab-af7c-610c42f72dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:0d:f8,bridge_name='br-int',has_traffic_filtering=True,id=85ea1c1b-efa0-4179-97a6-b2160ac4ae30,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ea1c1b-ef') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG os_vif [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0d:f8,bridge_name='br-int',has_traffic_filtering=True,id=85ea1c1b-efa0-4179-97a6-b2160ac4ae30,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ea1c1b-ef') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85ea1c1b-ef, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85ea1c1b-ef, col_values=(('external_ids', {'iface-id': '85ea1c1b-efa0-4179-97a6-b2160ac4ae30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:0d:f8', 'vm-uuid': 'c0060792-4093-43ab-af7c-610c42f72dca'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:41 user nova-compute[72447]: INFO os_vif [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0d:f8,bridge_name='br-int',has_traffic_filtering=True,id=85ea1c1b-efa0-4179-97a6-b2160ac4ae30,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ea1c1b-ef')
Jul 31 12:49:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:49:41 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] No VIF found with MAC fa:16:3e:27:0d:f8, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:49:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:43 user nova-compute[72447]: DEBUG nova.compute.manager [req-ca2c595f-4008-471d-ba72-fe913e442d71 req-4d89410d-87eb-4236-a61b-8bb6002ba6e3 service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Received event network-vif-plugged-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:49:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ca2c595f-4008-471d-ba72-fe913e442d71 req-4d89410d-87eb-4236-a61b-8bb6002ba6e3 service nova] Acquiring lock "c0060792-4093-43ab-af7c-610c42f72dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:49:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ca2c595f-4008-471d-ba72-fe913e442d71 req-4d89410d-87eb-4236-a61b-8bb6002ba6e3 service nova] Lock "c0060792-4093-43ab-af7c-610c42f72dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:49:43 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ca2c595f-4008-471d-ba72-fe913e442d71 req-4d89410d-87eb-4236-a61b-8bb6002ba6e3 service nova] Lock "c0060792-4093-43ab-af7c-610c42f72dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:49:43 user nova-compute[72447]: DEBUG nova.compute.manager [req-ca2c595f-4008-471d-ba72-fe913e442d71 req-4d89410d-87eb-4236-a61b-8bb6002ba6e3 service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] No waiting events found dispatching network-vif-plugged-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:49:43 user nova-compute[72447]: WARNING nova.compute.manager [req-ca2c595f-4008-471d-ba72-fe913e442d71 req-4d89410d-87eb-4236-a61b-8bb6002ba6e3 service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Received unexpected event network-vif-plugged-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 for instance with vm_state building and task_state spawning.
Jul 31 12:49:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807784.925746, c0060792-4093-43ab-af7c-610c42f72dca => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:49:44 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] VM Resumed (Lifecycle Event)
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:49:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Instance spawned successfully.
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:49:44 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807784.9310415, c0060792-4093-43ab-af7c-610c42f72dca => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:49:44 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] VM Started (Lifecycle Event)
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:49:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:49:45 user nova-compute[72447]: INFO nova.compute.manager [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Took 4.94 seconds to spawn the instance on the hypervisor.
Jul 31 12:49:45 user nova-compute[72447]: DEBUG nova.compute.manager [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:49:45 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:49:45 user nova-compute[72447]: INFO nova.compute.manager [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Took 12.66 seconds to build instance.
Jul 31 12:49:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-c427a5a0-6873-4c99-872a-cf8ee6a19401 req-f4d0c42c-0d83-43a0-8926-ca148b50adbe service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Received event network-vif-plugged-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:49:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c427a5a0-6873-4c99-872a-cf8ee6a19401 req-f4d0c42c-0d83-43a0-8926-ca148b50adbe service nova] Acquiring lock "c0060792-4093-43ab-af7c-610c42f72dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:49:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c427a5a0-6873-4c99-872a-cf8ee6a19401 req-f4d0c42c-0d83-43a0-8926-ca148b50adbe service nova] Lock "c0060792-4093-43ab-af7c-610c42f72dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:49:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-c427a5a0-6873-4c99-872a-cf8ee6a19401 req-f4d0c42c-0d83-43a0-8926-ca148b50adbe service nova] Lock "c0060792-4093-43ab-af7c-610c42f72dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:49:45 user nova-compute[72447]: DEBUG nova.compute.manager [req-c427a5a0-6873-4c99-872a-cf8ee6a19401 req-f4d0c42c-0d83-43a0-8926-ca148b50adbe service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] No waiting events found dispatching network-vif-plugged-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:49:45 user nova-compute[72447]: WARNING nova.compute.manager [req-c427a5a0-6873-4c99-872a-cf8ee6a19401 req-f4d0c42c-0d83-43a0-8926-ca148b50adbe service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Received unexpected event network-vif-plugged-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 for instance with vm_state active and task_state None.
Jul 31 12:49:45 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-01583b27-044a-419c-b5c8-ff37450fc2a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "c0060792-4093-43ab-af7c-610c42f72dca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.756s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:49:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:49:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:50:20 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:50:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:50:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:50:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:50:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:50:20 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:50:20 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid c0060792-4093-43ab-af7c-610c42f72dca {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:50:20 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updating instance_info_cache with network_info: [{"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:50:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:50:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:50:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:50:23 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:50:23 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:50:23 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:50:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:50:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:50:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=25.152164459228516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance c0060792-4093-43ab-af7c-610c42f72dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:50:25 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:50:26 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:50:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:50:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:50:26 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:50:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:50:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:50:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:50:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:50:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:32 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:50:35 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:50:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:50:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:50:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:50:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:50:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:50:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:50:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:51:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:51:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:51:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:51:19 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:51:20 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:51:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:51:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:51:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:51:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:51:20 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:51:20 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid c0060792-4093-43ab-af7c-610c42f72dca {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:51:20 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updating instance_info_cache with network_info: [{"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:51:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:51:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:51:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:51:23 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:51:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-82ad642b-d21b-418d-bb57-a21125066e3a req-78af8f13-0ed2-44ba-a159-e27db7ee850b service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Received event network-changed-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:51:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-82ad642b-d21b-418d-bb57-a21125066e3a req-78af8f13-0ed2-44ba-a159-e27db7ee850b service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Refreshing instance network info cache due to event network-changed-85ea1c1b-efa0-4179-97a6-b2160ac4ae30. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:51:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-82ad642b-d21b-418d-bb57-a21125066e3a req-78af8f13-0ed2-44ba-a159-e27db7ee850b service nova] Acquiring lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:51:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-82ad642b-d21b-418d-bb57-a21125066e3a req-78af8f13-0ed2-44ba-a159-e27db7ee850b service nova] Acquired lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:51:23 user nova-compute[72447]: DEBUG nova.network.neutron [req-82ad642b-d21b-418d-bb57-a21125066e3a req-78af8f13-0ed2-44ba-a159-e27db7ee850b service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Refreshing network info cache for port 85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:51:24 user nova-compute[72447]: DEBUG nova.network.neutron [req-82ad642b-d21b-418d-bb57-a21125066e3a req-78af8f13-0ed2-44ba-a159-e27db7ee850b service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updated VIF entry in instance network info cache for port 85ea1c1b-efa0-4179-97a6-b2160ac4ae30. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:51:24 user nova-compute[72447]: DEBUG nova.network.neutron [req-82ad642b-d21b-418d-bb57-a21125066e3a req-78af8f13-0ed2-44ba-a159-e27db7ee850b service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updating instance_info_cache with network_info: [{"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:51:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-82ad642b-d21b-418d-bb57-a21125066e3a req-78af8f13-0ed2-44ba-a159-e27db7ee850b service nova] Releasing lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:51:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:51:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8848MB free_disk=25.15145492553711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance c0060792-4093-43ab-af7c-610c42f72dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:51:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:51:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:51:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:29 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:51:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "273deab0-8638-4536-82f9-29be8729b75a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:51:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "273deab0-8638-4536-82f9-29be8729b75a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:51:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:51:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:51:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:51:31 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:51:31 user nova-compute[72447]: INFO nova.compute.claims [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Claim successful on node user
Jul 31 12:51:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:31 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:51:31 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:51:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:51:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:51:31 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:51:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:51:31 user nova-compute[72447]: DEBUG nova.network.neutron [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:51:31 user nova-compute[72447]: DEBUG nova.compute.manager [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:51:31 user nova-compute[72447]: INFO nova.virt.block_device [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Booting with volume snapshot dd97673f-dbdc-413e-add6-cee8be17d096 at /dev/vda
Jul 31 12:51:31 user nova-compute[72447]: DEBUG nova.policy [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10213ac072b24a899a4cc1403a601edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1be744ad5e14a4a8d1ca055e023e2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:51:32 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:51:32 user nova-compute[72447]: DEBUG nova.network.neutron [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Successfully created port: c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG nova.network.neutron [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Successfully updated port: c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "refresh_cache-273deab0-8638-4536-82f9-29be8729b75a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquired lock "refresh_cache-273deab0-8638-4536-82f9-29be8729b75a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG nova.network.neutron [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-64cad0af-cdde-4df5-887b-5b5e867eabc5 req-c90b4ab7-765a-4d8f-8e82-b48389e97232 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Received event network-changed-c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG nova.compute.manager [req-64cad0af-cdde-4df5-887b-5b5e867eabc5 req-c90b4ab7-765a-4d8f-8e82-b48389e97232 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Refreshing instance network info cache due to event network-changed-c2de472d-fd53-4cea-b4c8-6ae15c38643b. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-64cad0af-cdde-4df5-887b-5b5e867eabc5 req-c90b4ab7-765a-4d8f-8e82-b48389e97232 service nova] Acquiring lock "refresh_cache-273deab0-8638-4536-82f9-29be8729b75a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG nova.network.neutron [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG nova.network.neutron [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Updating instance_info_cache with network_info: [{"id": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "address": "fa:16:3e:64:44:3c", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2de472d-fd", "ovs_interfaceid": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Releasing lock "refresh_cache-273deab0-8638-4536-82f9-29be8729b75a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG nova.compute.manager [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Instance network_info: |[{"id": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "address": "fa:16:3e:64:44:3c", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2de472d-fd", "ovs_interfaceid": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-64cad0af-cdde-4df5-887b-5b5e867eabc5 req-c90b4ab7-765a-4d8f-8e82-b48389e97232 service nova] Acquired lock "refresh_cache-273deab0-8638-4536-82f9-29be8729b75a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:51:33 user nova-compute[72447]: DEBUG nova.network.neutron [req-64cad0af-cdde-4df5-887b-5b5e867eabc5 req-c90b4ab7-765a-4d8f-8e82-b48389e97232 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Refreshing network info cache for port c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:51:34 user nova-compute[72447]: DEBUG nova.network.neutron [req-64cad0af-cdde-4df5-887b-5b5e867eabc5 req-c90b4ab7-765a-4d8f-8e82-b48389e97232 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Updated VIF entry in instance network info cache for port c2de472d-fd53-4cea-b4c8-6ae15c38643b. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:51:34 user nova-compute[72447]: DEBUG nova.network.neutron [req-64cad0af-cdde-4df5-887b-5b5e867eabc5 req-c90b4ab7-765a-4d8f-8e82-b48389e97232 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Updating instance_info_cache with network_info: [{"id": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "address": "fa:16:3e:64:44:3c", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2de472d-fd", "ovs_interfaceid": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:51:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-64cad0af-cdde-4df5-887b-5b5e867eabc5 req-c90b4ab7-765a-4d8f-8e82-b48389e97232 service nova] Releasing lock "refresh_cache-273deab0-8638-4536-82f9-29be8729b75a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:51:35 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:51:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG os_brick.utils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[484ee8b2-7c87-4c8d-af52-0cb49de5233d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[525e5147-5f14-433e-89a4-9b9c6a64e163]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf79260-4357-43cf-adb6-82d413624c25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8fe2ff-6434-44fb-af4e-ede50529413d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:51:37 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:51:37 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[38771035-e7c3-41b4-98f7-3692cc14f44d]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG os_brick.utils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:51:37 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Updating existing volume attachment record: 040e9167-52df-4fee-ae5e-8ebf0a14405d {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:51:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.compute.manager [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:51:44 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Creating image(s)
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Ensure instance console log exists: /opt/stack/data/nova/instances/273deab0-8638-4536-82f9-29be8729b75a/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Start _get_guest_xml network_info=[{"id": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "address": "fa:16:3e:64:44:3c", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2de472d-fd", "ovs_interfaceid": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-31T12:51:25Z,direct_url=<?>,disk_format='qcow2',id=3c6a72a7-5edf-4028-9d0f-2dc0f0299d16,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-992812354',owner='e1be744ad5e14a4a8d1ca055e023e2fb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-31T12:51:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '040e9167-52df-4fee-ae5e-8ebf0a14405d', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxSHjNYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '273deab0-8638-4536-82f9-29be8729b75a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f051398e-b65d-48be-8778-3d7d9955a384', 'serial': 'f051398e-b65d-48be-8778-3d7d9955a384'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:51:44 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:51:44 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-31T12:51:25Z,direct_url=<?>,disk_format='qcow2',id=3c6a72a7-5edf-4028-9d0f-2dc0f0299d16,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-992812354',owner='e1be744ad5e14a4a8d1ca055e023e2fb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-31T12:51:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxSHjNYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:51:44 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:51:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:51:44 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:51:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:51:44 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[289aa0c2-0a8c-47e7-8f7b-8c11a477df1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:51:44 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2604c9db-c333-4f62-886b-60fcfc2425a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384] added
Jul 31 12:51:44 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99cb1ec-e7fb-4141-8e65-b9bf70d99b6c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab1aff6-6364-492e-b1c6-78fa3719fa4a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:51:44 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxSHjNYs {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxSHjNYs" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a71ee01-73c3-4236-b618-5ce9ded7ac9b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oxSHjNYs'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[788fb1b6-e687-462b-9277-4391eb14ed4c]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf475e4-f7c0-4257-ab6b-8de7733d88e6]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)
Jul 31 12:51:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)
Jul 31 12:51:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0434f5fa-51e3-4210-95c7-456e020de175]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384, portal: 172.16.0.220,3260]
Jul 31 12:51:45 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384, portal: 172.16.0.220,3260] successful.
Jul 31 12:51:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbac977-d450-46b5-9837-5d5dfcb4ad9b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[451b241a-12de-4183-a53c-cb68e6846af4]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)
Jul 31 12:51:45 user nova-compute[72447]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 (non-flash)
Jul 31 12:51:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)
Jul 31 12:51:45 user nova-compute[72447]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 (non-flash)
Jul 31 12:51:45 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9622e769-1c52-41bd-b942-545a1757182a]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:51:45 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxSHjNYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26461323730653761', 'path': '/dev/sdc'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461323730653761', 'path': '/dev/sdc'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-456197049',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-456197049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-456197049',id=48,image_ref='3c6a72a7-5edf-4028-9d0f-2dc0f0299d16',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNpLea13sPUNX68qeDtIiTq5GQfudpVmYOU8YD76IRLBgONk9iLo3JZy2GV4uYKrMTowZL+2TB46iFU6VmFpPKYFSHFc6yokoaO8eBQddrO1r+3DHDhpvRkn5rDE+QvEw==',key_name='tempest-keypair-21458926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-xxqow1ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-37536115',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:51:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10213ac072b24a899a4cc1403a601edf',uuid=273deab0-8638-4536-82f9-29be8729b75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "address": "fa:16:3e:64:44:3c", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2de472d-fd", "ovs_interfaceid": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "address": "fa:16:3e:64:44:3c", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2de472d-fd", "ovs_interfaceid": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2de472d-fd53-4cea-b4c8-6ae15c38643b,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2de472d-fd') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG nova.objects.instance [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lazy-loading 'pci_devices' on Instance uuid 273deab0-8638-4536-82f9-29be8729b75a {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:51:46 user nova-compute[72447]:   <uuid>273deab0-8638-4536-82f9-29be8729b75a</uuid>
Jul 31 12:51:46 user nova-compute[72447]:   <name>instance-00000030</name>
Jul 31 12:51:46 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:51:46 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:51:46 user nova-compute[72447]:   <metadata>
Jul 31 12:51:46 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:51:46 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:51:46 user nova-compute[72447]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-456197049</nova:name>
Jul 31 12:51:46 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:51:44</nova:creationTime>
Jul 31 12:51:46 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:51:46 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:51:46 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:51:46 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:51:46 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:51:46 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:51:46 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:51:46 user nova-compute[72447]:       <nova:owner>
Jul 31 12:51:46 user nova-compute[72447]:         <nova:user uuid="10213ac072b24a899a4cc1403a601edf">tempest-TestVolumeBootPattern-37536115-project-member</nova:user>
Jul 31 12:51:46 user nova-compute[72447]:         <nova:project uuid="e1be744ad5e14a4a8d1ca055e023e2fb">tempest-TestVolumeBootPattern-37536115</nova:project>
Jul 31 12:51:46 user nova-compute[72447]:       </nova:owner>
Jul 31 12:51:46 user nova-compute[72447]:       <nova:root type="image" uuid="3c6a72a7-5edf-4028-9d0f-2dc0f0299d16"/>
Jul 31 12:51:46 user nova-compute[72447]:       <nova:ports>
Jul 31 12:51:46 user nova-compute[72447]:         <nova:port uuid="c2de472d-fd53-4cea-b4c8-6ae15c38643b">
Jul 31 12:51:46 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 12:51:46 user nova-compute[72447]:         </nova:port>
Jul 31 12:51:46 user nova-compute[72447]:       </nova:ports>
Jul 31 12:51:46 user nova-compute[72447]:     </nova:instance>
Jul 31 12:51:46 user nova-compute[72447]:   </metadata>
Jul 31 12:51:46 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:51:46 user nova-compute[72447]:     <system>
Jul 31 12:51:46 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:51:46 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:51:46 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:51:46 user nova-compute[72447]:       <entry name="serial">273deab0-8638-4536-82f9-29be8729b75a</entry>
Jul 31 12:51:46 user nova-compute[72447]:       <entry name="uuid">273deab0-8638-4536-82f9-29be8729b75a</entry>
Jul 31 12:51:46 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:51:46 user nova-compute[72447]:     </system>
Jul 31 12:51:46 user nova-compute[72447]:   </sysinfo>
Jul 31 12:51:46 user nova-compute[72447]:   <os>
Jul 31 12:51:46 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:51:46 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:51:46 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:51:46 user nova-compute[72447]:   </os>
Jul 31 12:51:46 user nova-compute[72447]:   <features>
Jul 31 12:51:46 user nova-compute[72447]:     <acpi/>
Jul 31 12:51:46 user nova-compute[72447]:     <apic/>
Jul 31 12:51:46 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:51:46 user nova-compute[72447]:   </features>
Jul 31 12:51:46 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:51:46 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:51:46 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:51:46 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:51:46 user nova-compute[72447]:   </clock>
Jul 31 12:51:46 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:51:46 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:51:46 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:51:46 user nova-compute[72447]:   </cpu>
Jul 31 12:51:46 user nova-compute[72447]:   <devices>
Jul 31 12:51:46 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:51:46 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:51:46 user nova-compute[72447]:       <source dev="/dev/sdc"/>
Jul 31 12:51:46 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:51:46 user nova-compute[72447]:       <serial>f051398e-b65d-48be-8778-3d7d9955a384</serial>
Jul 31 12:51:46 user nova-compute[72447]:     </disk>
Jul 31 12:51:46 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:51:46 user nova-compute[72447]:       <mac address="fa:16:3e:64:44:3c"/>
Jul 31 12:51:46 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:51:46 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:51:46 user nova-compute[72447]:       <target dev="tapc2de472d-fd"/>
Jul 31 12:51:46 user nova-compute[72447]:     </interface>
Jul 31 12:51:46 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:51:46 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/273deab0-8638-4536-82f9-29be8729b75a/console.log" append="off"/>
Jul 31 12:51:46 user nova-compute[72447]:     </serial>
Jul 31 12:51:46 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:51:46 user nova-compute[72447]:     <video>
Jul 31 12:51:46 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:51:46 user nova-compute[72447]:     </video>
Jul 31 12:51:46 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:51:46 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:51:46 user nova-compute[72447]:     </rng>
Jul 31 12:51:46 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:51:46 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:51:46 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:51:46 user nova-compute[72447]:     </memballoon>
Jul 31 12:51:46 user nova-compute[72447]:   </devices>
Jul 31 12:51:46 user nova-compute[72447]: </domain>
Jul 31 12:51:46 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-456197049',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-456197049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-456197049',id=48,image_ref='3c6a72a7-5edf-4028-9d0f-2dc0f0299d16',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNpLea13sPUNX68qeDtIiTq5GQfudpVmYOU8YD76IRLBgONk9iLo3JZy2GV4uYKrMTowZL+2TB46iFU6VmFpPKYFSHFc6yokoaO8eBQddrO1r+3DHDhpvRkn5rDE+QvEw==',key_name='tempest-keypair-21458926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-xxqow1ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-37536115',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:51:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10213ac072b24a899a4cc1403a601edf',uuid=273deab0-8638-4536-82f9-29be8729b75a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "address": "fa:16:3e:64:44:3c", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2de472d-fd", "ovs_interfaceid": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "address": "fa:16:3e:64:44:3c", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2de472d-fd", "ovs_interfaceid": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2de472d-fd53-4cea-b4c8-6ae15c38643b,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2de472d-fd') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG os_vif [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2de472d-fd53-4cea-b4c8-6ae15c38643b,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2de472d-fd') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2de472d-fd, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2de472d-fd, col_values=(('external_ids', {'iface-id': 'c2de472d-fd53-4cea-b4c8-6ae15c38643b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:44:3c', 'vm-uuid': '273deab0-8638-4536-82f9-29be8729b75a'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:46 user nova-compute[72447]: INFO os_vif [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2de472d-fd53-4cea-b4c8-6ae15c38643b,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2de472d-fd')
Jul 31 12:51:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:51:46 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] No VIF found with MAC fa:16:3e:64:44:3c, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:51:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-daf760f1-f13e-467d-8084-fabb49628363 req-815ee1e9-b4ff-4819-9d0b-9f2b635b67e0 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Received event network-vif-plugged-c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:51:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-daf760f1-f13e-467d-8084-fabb49628363 req-815ee1e9-b4ff-4819-9d0b-9f2b635b67e0 service nova] Acquiring lock "273deab0-8638-4536-82f9-29be8729b75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:51:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-daf760f1-f13e-467d-8084-fabb49628363 req-815ee1e9-b4ff-4819-9d0b-9f2b635b67e0 service nova] Lock "273deab0-8638-4536-82f9-29be8729b75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:51:47 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-daf760f1-f13e-467d-8084-fabb49628363 req-815ee1e9-b4ff-4819-9d0b-9f2b635b67e0 service nova] Lock "273deab0-8638-4536-82f9-29be8729b75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:51:47 user nova-compute[72447]: DEBUG nova.compute.manager [req-daf760f1-f13e-467d-8084-fabb49628363 req-815ee1e9-b4ff-4819-9d0b-9f2b635b67e0 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] No waiting events found dispatching network-vif-plugged-c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:51:47 user nova-compute[72447]: WARNING nova.compute.manager [req-daf760f1-f13e-467d-8084-fabb49628363 req-815ee1e9-b4ff-4819-9d0b-9f2b635b67e0 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Received unexpected event network-vif-plugged-c2de472d-fd53-4cea-b4c8-6ae15c38643b for instance with vm_state building and task_state spawning.
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807909.6349123, 273deab0-8638-4536-82f9-29be8729b75a => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:51:49 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 273deab0-8638-4536-82f9-29be8729b75a] VM Resumed (Lifecycle Event)
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:51:49 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Instance spawned successfully.
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:51:49 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 273deab0-8638-4536-82f9-29be8729b75a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690807909.636771, 273deab0-8638-4536-82f9-29be8729b75a => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:51:49 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 273deab0-8638-4536-82f9-29be8729b75a] VM Started (Lifecycle Event)
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:51:49 user nova-compute[72447]: INFO nova.compute.manager [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Took 4.90 seconds to spawn the instance on the hypervisor.
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:51:49 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 273deab0-8638-4536-82f9-29be8729b75a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:51:49 user nova-compute[72447]: INFO nova.compute.manager [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Took 18.31 seconds to build instance.
Jul 31 12:51:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-39cb8f2c-707f-404e-bff9-8bcc9466693c tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "273deab0-8638-4536-82f9-29be8729b75a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.406s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-d3f8e25a-48b9-45c3-b514-15ca37e1f9ab req-e12c792f-2dee-49f9-ab75-2a67c35bc6ff service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Received event network-vif-plugged-c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:51:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d3f8e25a-48b9-45c3-b514-15ca37e1f9ab req-e12c792f-2dee-49f9-ab75-2a67c35bc6ff service nova] Acquiring lock "273deab0-8638-4536-82f9-29be8729b75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:51:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d3f8e25a-48b9-45c3-b514-15ca37e1f9ab req-e12c792f-2dee-49f9-ab75-2a67c35bc6ff service nova] Lock "273deab0-8638-4536-82f9-29be8729b75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:51:49 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-d3f8e25a-48b9-45c3-b514-15ca37e1f9ab req-e12c792f-2dee-49f9-ab75-2a67c35bc6ff service nova] Lock "273deab0-8638-4536-82f9-29be8729b75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:51:49 user nova-compute[72447]: DEBUG nova.compute.manager [req-d3f8e25a-48b9-45c3-b514-15ca37e1f9ab req-e12c792f-2dee-49f9-ab75-2a67c35bc6ff service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] No waiting events found dispatching network-vif-plugged-c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:51:49 user nova-compute[72447]: WARNING nova.compute.manager [req-d3f8e25a-48b9-45c3-b514-15ca37e1f9ab req-e12c792f-2dee-49f9-ab75-2a67c35bc6ff service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Received unexpected event network-vif-plugged-c2de472d-fd53-4cea-b4c8-6ae15c38643b for instance with vm_state active and task_state None.
Jul 31 12:51:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:51:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:16 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:52:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:20 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:52:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:21 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:52:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:52:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:52:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:52:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:52:21 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:52:21 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid c0060792-4093-43ab-af7c-610c42f72dca {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:52:21 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updating instance_info_cache with network_info: [{"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:52:21 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-c0060792-4093-43ab-af7c-610c42f72dca" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:52:21 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:52:24 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:52:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:52:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:52:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8695MB free_disk=25.149505615234375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance c0060792-4093-43ab-af7c-610c42f72dca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 273deab0-8638-4536-82f9-29be8729b75a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:52:25 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:52:26 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:52:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:52:26 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:52:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:52:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:52:30 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:52:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:32 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:52:35 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:52:35 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72447) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 12:52:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:52:37 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:52:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:52:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:52:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:52:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:52:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:52:49 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:52:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 12:52:49 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] There are 0 instances to clean {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 12:52:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:52:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:53:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:53:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:53:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:53:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:53:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:53:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-273deab0-8638-4536-82f9-29be8729b75a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-273deab0-8638-4536-82f9-29be8729b75a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG nova.compute.manager [req-7f50b76b-a140-4eea-a60e-964f42935a75 req-f6486ed0-3f09-4ce1-b042-7682c0d01b5e service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Received event network-changed-c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG nova.compute.manager [req-7f50b76b-a140-4eea-a60e-964f42935a75 req-f6486ed0-3f09-4ce1-b042-7682c0d01b5e service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Refreshing instance network info cache due to event network-changed-c2de472d-fd53-4cea-b4c8-6ae15c38643b. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7f50b76b-a140-4eea-a60e-964f42935a75 req-f6486ed0-3f09-4ce1-b042-7682c0d01b5e service nova] Acquiring lock "refresh_cache-273deab0-8638-4536-82f9-29be8729b75a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Updating instance_info_cache with network_info: [{"id": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "address": "fa:16:3e:64:44:3c", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2de472d-fd", "ovs_interfaceid": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-273deab0-8638-4536-82f9-29be8729b75a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7f50b76b-a140-4eea-a60e-964f42935a75 req-f6486ed0-3f09-4ce1-b042-7682c0d01b5e service nova] Acquired lock "refresh_cache-273deab0-8638-4536-82f9-29be8729b75a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG nova.network.neutron [req-7f50b76b-a140-4eea-a60e-964f42935a75 req-f6486ed0-3f09-4ce1-b042-7682c0d01b5e service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Refreshing network info cache for port c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:53:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "273deab0-8638-4536-82f9-29be8729b75a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "273deab0-8638-4536-82f9-29be8729b75a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "273deab0-8638-4536-82f9-29be8729b75a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "273deab0-8638-4536-82f9-29be8729b75a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "273deab0-8638-4536-82f9-29be8729b75a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:53:23 user nova-compute[72447]: INFO nova.compute.manager [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Terminating instance
Jul 31 12:53:23 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG nova.network.neutron [req-7f50b76b-a140-4eea-a60e-964f42935a75 req-f6486ed0-3f09-4ce1-b042-7682c0d01b5e service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Updated VIF entry in instance network info cache for port c2de472d-fd53-4cea-b4c8-6ae15c38643b. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG nova.network.neutron [req-7f50b76b-a140-4eea-a60e-964f42935a75 req-f6486ed0-3f09-4ce1-b042-7682c0d01b5e service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Updating instance_info_cache with network_info: [{"id": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "address": "fa:16:3e:64:44:3c", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2de472d-fd", "ovs_interfaceid": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-7f50b76b-a140-4eea-a60e-964f42935a75 req-f6486ed0-3f09-4ce1-b042-7682c0d01b5e service nova] Releasing lock "refresh_cache-273deab0-8638-4536-82f9-29be8729b75a" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-ecf5e684-8284-4f02-921d-d6cc7801e4df req-af997c2e-f7e3-4336-a7ab-718f7cff42d5 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Received event network-vif-unplugged-c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ecf5e684-8284-4f02-921d-d6cc7801e4df req-af997c2e-f7e3-4336-a7ab-718f7cff42d5 service nova] Acquiring lock "273deab0-8638-4536-82f9-29be8729b75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ecf5e684-8284-4f02-921d-d6cc7801e4df req-af997c2e-f7e3-4336-a7ab-718f7cff42d5 service nova] Lock "273deab0-8638-4536-82f9-29be8729b75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ecf5e684-8284-4f02-921d-d6cc7801e4df req-af997c2e-f7e3-4336-a7ab-718f7cff42d5 service nova] Lock "273deab0-8638-4536-82f9-29be8729b75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-ecf5e684-8284-4f02-921d-d6cc7801e4df req-af997c2e-f7e3-4336-a7ab-718f7cff42d5 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] No waiting events found dispatching network-vif-unplugged-c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG nova.compute.manager [req-ecf5e684-8284-4f02-921d-d6cc7801e4df req-af997c2e-f7e3-4336-a7ab-718f7cff42d5 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Received event network-vif-unplugged-c2de472d-fd53-4cea-b4c8-6ae15c38643b for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:24 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Instance destroyed successfully.
Jul 31 12:53:24 user nova-compute[72447]: DEBUG nova.objects.instance [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lazy-loading 'resources' on Instance uuid 273deab0-8638-4536-82f9-29be8729b75a {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-456197049',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-456197049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-456197049',id=48,image_ref='3c6a72a7-5edf-4028-9d0f-2dc0f0299d16',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNpLea13sPUNX68qeDtIiTq5GQfudpVmYOU8YD76IRLBgONk9iLo3JZy2GV4uYKrMTowZL+2TB46iFU6VmFpPKYFSHFc6yokoaO8eBQddrO1r+3DHDhpvRkn5rDE+QvEw==',key_name='tempest-keypair-21458926',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:51:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-xxqow1ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-37536115',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:51:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10213ac072b24a899a4cc1403a601edf',uuid=273deab0-8638-4536-82f9-29be8729b75a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "address": "fa:16:3e:64:44:3c", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2de472d-fd", "ovs_interfaceid": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "address": "fa:16:3e:64:44:3c", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2de472d-fd", "ovs_interfaceid": "c2de472d-fd53-4cea-b4c8-6ae15c38643b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2de472d-fd53-4cea-b4c8-6ae15c38643b,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2de472d-fd') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_vif [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2de472d-fd53-4cea-b4c8-6ae15c38643b,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2de472d-fd') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2de472d-fd, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:53:24 user nova-compute[72447]: INFO os_vif [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=c2de472d-fd53-4cea-b4c8-6ae15c38643b,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2de472d-fd')
Jul 31 12:53:24 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxSHjNYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:53:24 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[759342fe-1c68-41ab-af80-ed81eb48d651]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f5c541-352a-498a-9859-ea1ee18c8e4b]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)
Jul 31 12:53:24 user nova-compute[72447]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 (non-flash)
Jul 31 12:53:24 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)
Jul 31 12:53:24 user nova-compute[72447]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 (non-flash)
Jul 31 12:53:24 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0668105360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384'): ({'sdc'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Removing single pathed devices sdc {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e475270b-209d-4301-90d0-0e69045e1835]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[11900538-fb13-4aa7-be18-5c29a5029ca1]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flushing IO for device /dev/sdc {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[055527c4-8de3-4662-a6cf-4b3fcf784896]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61545cd-e587-44c1-9e38-e6a480e69b8c]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fd9d5c61', '/dev/disk/by-id/scsi-1SCST_BIOfd9d5c61-da270e7a1b6ec5dc', '/dev/disk/by-id/scsi-26461323730653761') {{(pid=83492) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be12697-ac4d-4cd9-b98a-a99b91653bd8]: (4, None) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf4aa33-60d1-4283-a0ea-72295a1b95eb]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[227034a1-7e7e-4d7b-84fd-43a029d8b900]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384, portal: 172.16.0.220,3260]
Jul 31 12:53:24 user nova-compute[72447]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384, portal: 172.16.0.220,3260] successful.
Jul 31 12:53:24 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f051398e-b65d-48be-8778-3d7d9955a384 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0014c7bf-05af-4d77-ab2b-ac694a65d27b]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== disconnect_volume: return (308ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:53:24 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Deleting instance files /opt/stack/data/nova/instances/273deab0-8638-4536-82f9-29be8729b75a_del
Jul 31 12:53:24 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Deletion of /opt/stack/data/nova/instances/273deab0-8638-4536-82f9-29be8729b75a_del complete
Jul 31 12:53:24 user nova-compute[72447]: INFO nova.compute.manager [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 31 12:53:24 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:53:24 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 273deab0-8638-4536-82f9-29be8729b75a] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:53:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:53:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:53:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:53:25 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-3aa57f20-85e6-4d11-b350-ef04422d104c req-18099eb5-ef1e-4935-afad-c589d7597640 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Received event network-vif-plugged-c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:53:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3aa57f20-85e6-4d11-b350-ef04422d104c req-18099eb5-ef1e-4935-afad-c589d7597640 service nova] Acquiring lock "273deab0-8638-4536-82f9-29be8729b75a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:53:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3aa57f20-85e6-4d11-b350-ef04422d104c req-18099eb5-ef1e-4935-afad-c589d7597640 service nova] Lock "273deab0-8638-4536-82f9-29be8729b75a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:53:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-3aa57f20-85e6-4d11-b350-ef04422d104c req-18099eb5-ef1e-4935-afad-c589d7597640 service nova] Lock "273deab0-8638-4536-82f9-29be8729b75a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:53:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-3aa57f20-85e6-4d11-b350-ef04422d104c req-18099eb5-ef1e-4935-afad-c589d7597640 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] No waiting events found dispatching network-vif-plugged-c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:53:25 user nova-compute[72447]: WARNING nova.compute.manager [req-3aa57f20-85e6-4d11-b350-ef04422d104c req-18099eb5-ef1e-4935-afad-c589d7597640 service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Received unexpected event network-vif-plugged-c2de472d-fd53-4cea-b4c8-6ae15c38643b for instance with vm_state active and task_state deleting.
Jul 31 12:53:25 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:53:25 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Took 1.31 seconds to deallocate network for instance.
Jul 31 12:53:25 user nova-compute[72447]: DEBUG nova.compute.manager [req-53aa9ba1-b303-4457-9805-7c6c582d48b5 req-1e1f0bf2-d2e9-44e6-a571-d46a026b2a0b service nova] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Received event network-vif-deleted-c2de472d-fd53-4cea-b4c8-6ae15c38643b {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:53:26 user nova-compute[72447]: INFO nova.compute.manager [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Took 0.73 seconds to detach 1 volumes for instance.
Jul 31 12:53:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Deleting volume: f051398e-b65d-48be-8778-3d7d9955a384 {{(pid=72447) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 12:53:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:53:26 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:53:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Refreshing inventories for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 12:53:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Updating ProviderTree inventory for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 12:53:26 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 12:53:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Refreshing aggregate associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, aggregates: None {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 12:53:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Refreshing trait associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 12:53:26 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:53:26 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:53:27 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Deleted allocations for instance 273deab0-8638-4536-82f9-29be8729b75a
Jul 31 12:53:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-d907ebc3-e4fa-4151-bd5c-03004a5349fd tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "273deab0-8638-4536-82f9-29be8729b75a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.757s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:53:27 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:53:27 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:53:27 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=25.148632049560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance c0060792-4093-43ab-af7c-610c42f72dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:53:27 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:53:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:53:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:29 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:53:31 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:53:33 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:53:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:53:37 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:53:39 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690808004.1443498, 273deab0-8638-4536-82f9-29be8729b75a => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:53:39 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 273deab0-8638-4536-82f9-29be8729b75a] VM Stopped (Lifecycle Event)
Jul 31 12:53:39 user nova-compute[72447]: DEBUG nova.compute.manager [None req-234dc11e-a85c-4855-b8a9-5902a7d5c731 None None] [instance: 273deab0-8638-4536-82f9-29be8729b75a] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:53:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:53:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:53:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:53:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:53:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:53:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:53:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:53:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:54:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:54:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:54:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:54:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:54:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "c0060792-4093-43ab-af7c-610c42f72dca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "c0060792-4093-43ab-af7c-610c42f72dca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "c0060792-4093-43ab-af7c-610c42f72dca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "c0060792-4093-43ab-af7c-610c42f72dca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "c0060792-4093-43ab-af7c-610c42f72dca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:54:17 user nova-compute[72447]: INFO nova.compute.manager [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Terminating instance
Jul 31 12:54:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-2a273e33-02b5-4fee-93d8-d6546e70b5f9 req-0fd627b2-f47f-45e3-8f12-136a9d13009c service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Received event network-vif-unplugged-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2a273e33-02b5-4fee-93d8-d6546e70b5f9 req-0fd627b2-f47f-45e3-8f12-136a9d13009c service nova] Acquiring lock "c0060792-4093-43ab-af7c-610c42f72dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2a273e33-02b5-4fee-93d8-d6546e70b5f9 req-0fd627b2-f47f-45e3-8f12-136a9d13009c service nova] Lock "c0060792-4093-43ab-af7c-610c42f72dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-2a273e33-02b5-4fee-93d8-d6546e70b5f9 req-0fd627b2-f47f-45e3-8f12-136a9d13009c service nova] Lock "c0060792-4093-43ab-af7c-610c42f72dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-2a273e33-02b5-4fee-93d8-d6546e70b5f9 req-0fd627b2-f47f-45e3-8f12-136a9d13009c service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] No waiting events found dispatching network-vif-unplugged-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-2a273e33-02b5-4fee-93d8-d6546e70b5f9 req-0fd627b2-f47f-45e3-8f12-136a9d13009c service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Received event network-vif-unplugged-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:17 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Instance destroyed successfully.
Jul 31 12:54:17 user nova-compute[72447]: DEBUG nova.objects.instance [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lazy-loading 'resources' on Instance uuid c0060792-4093-43ab-af7c-610c42f72dca {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-864886633',display_name='tempest-TestVolumeBootPattern-volume-backed-server-864886633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-864886633',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXAMk1AZ3kSCvFgmh4M1NrHqYZ765eJNN1i3GiPt9ZmhLGwGyejLPX8LhySC9UEV/GzwlZ6Yq8+C5ruz29w+cBWds/4j6gRfOUyNfyUb5OyYxQSlW8lPElErFBXVjef/A==',key_name='tempest-keypair-1016591083',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-2bq8fiuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10213ac072b24a899a4cc1403a601edf',uuid=c0060792-4093-43ab-af7c-610c42f72dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "address": "fa:16:3e:27:0d:f8", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ea1c1b-ef", "ovs_interfaceid": "85ea1c1b-efa0-4179-97a6-b2160ac4ae30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:0d:f8,bridge_name='br-int',has_traffic_filtering=True,id=85ea1c1b-efa0-4179-97a6-b2160ac4ae30,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ea1c1b-ef') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG os_vif [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:0d:f8,bridge_name='br-int',has_traffic_filtering=True,id=85ea1c1b-efa0-4179-97a6-b2160ac4ae30,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ea1c1b-ef') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85ea1c1b-ef, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:17 user nova-compute[72447]: INFO os_vif [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:0d:f8,bridge_name='br-int',has_traffic_filtering=True,id=85ea1c1b-efa0-4179-97a6-b2160ac4ae30,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ea1c1b-ef')
Jul 31 12:54:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeIqJPxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:54:17 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:54:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f94978-9f7c-48e2-8eff-bd9d83bb04f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[87344805-bec4-43e0-b4b5-7543939655eb]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)
Jul 31 12:54:17 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c (non-flash)
Jul 31 12:54:17 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f064867a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[83acc257-038b-47e9-a57e-b906a893618f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:54:17 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0769a539-4f71-4f5d-83eb-8c4af1f5622b]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdddbea-bb43-4fbc-9580-b417b2533939]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[670d1cd6-a8e9-4942-857d-e00ef4124fc5]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23162383862323735', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b65c4409', '/dev/disk/by-id/scsi-1SCST_BIOb65c4409-1b88b275c52fe0b6') {{(pid=83492) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5971d37f-9e84-4ed7-b7bd-d73e1124ee5b]: (4, None) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb629664-74b1-4c5a-85fa-bf554a36a526]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed4149a-75c8-4b4a-96e1-5208b7c470be]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c, portal: 172.16.0.220,3260]
Jul 31 12:54:18 user nova-compute[72447]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c, portal: 172.16.0.220,3260] successful.
Jul 31 12:54:18 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe3e0fa-d7ff-4bfe-89dc-ccad8d1d4e9e]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== disconnect_volume: return (314ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:54:18 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Deleting instance files /opt/stack/data/nova/instances/c0060792-4093-43ab-af7c-610c42f72dca_del
Jul 31 12:54:18 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Deletion of /opt/stack/data/nova/instances/c0060792-4093-43ab-af7c-610c42f72dca_del complete
Jul 31 12:54:18 user nova-compute[72447]: INFO nova.compute.manager [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Took 1.20 seconds to destroy the instance on the hypervisor.
Jul 31 12:54:18 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:54:18 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: c0060792-4093-43ab-af7c-610c42f72dca] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:54:19 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:54:19 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Took 0.89 seconds to deallocate network for instance.
Jul 31 12:54:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-71949041-145a-4fa9-9c2c-7eb392a8026e req-942c1242-a11f-4b95-a4ec-a10ab33278d1 service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Received event network-vif-deleted-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:54:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-14e532b4-9119-467b-873f-656af71ce72c req-68f70e1f-336a-4c67-bf6b-f32088e39608 service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Received event network-vif-plugged-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:54:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-14e532b4-9119-467b-873f-656af71ce72c req-68f70e1f-336a-4c67-bf6b-f32088e39608 service nova] Acquiring lock "c0060792-4093-43ab-af7c-610c42f72dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:54:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-14e532b4-9119-467b-873f-656af71ce72c req-68f70e1f-336a-4c67-bf6b-f32088e39608 service nova] Lock "c0060792-4093-43ab-af7c-610c42f72dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:54:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-14e532b4-9119-467b-873f-656af71ce72c req-68f70e1f-336a-4c67-bf6b-f32088e39608 service nova] Lock "c0060792-4093-43ab-af7c-610c42f72dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:54:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-14e532b4-9119-467b-873f-656af71ce72c req-68f70e1f-336a-4c67-bf6b-f32088e39608 service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] No waiting events found dispatching network-vif-plugged-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:54:19 user nova-compute[72447]: WARNING nova.compute.manager [req-14e532b4-9119-467b-873f-656af71ce72c req-68f70e1f-336a-4c67-bf6b-f32088e39608 service nova] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Received unexpected event network-vif-plugged-85ea1c1b-efa0-4179-97a6-b2160ac4ae30 for instance with vm_state active and task_state deleting.
Jul 31 12:54:19 user nova-compute[72447]: INFO nova.compute.manager [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Took 0.69 seconds to detach 1 volumes for instance.
Jul 31 12:54:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Deleting volume: bcbb9171-b3ab-4d8b-a1c4-207b70a2cd3c {{(pid=72447) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 12:54:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:54:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:54:20 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:54:20 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:54:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:54:20 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Deleted allocations for instance c0060792-4093-43ab-af7c-610c42f72dca
Jul 31 12:54:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-fdb3e278-3e47-4b2b-9857-9dbcf6be9df5 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "c0060792-4093-43ab-af7c-610c42f72dca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.196s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:54:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:54:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:54:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:54:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:54:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:24 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:54:26 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:54:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:54:27 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:54:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:54:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:54:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:54:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:54:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:54:29 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:54:29 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:54:29 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=25.14777374267578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:54:29 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:54:32 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:54:32 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690808057.8638222, c0060792-4093-43ab-af7c-610c42f72dca => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:54:32 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: c0060792-4093-43ab-af7c-610c42f72dca] VM Stopped (Lifecycle Event)
Jul 31 12:54:32 user nova-compute[72447]: DEBUG nova.compute.manager [None req-cf20271c-0c8b-451f-9d7b-7a1f46fee997 None None] [instance: c0060792-4093-43ab-af7c-610c42f72dca] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:54:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:33 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:54:37 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:54:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:54:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:54:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:54:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:54:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:54:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:54:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:54:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:54:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:54:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:54:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:54:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:54:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:55:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "9922cc93-204b-45dc-b1fd-89e56cadfe96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:55:17 user nova-compute[72447]: INFO nova.compute.claims [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Claim successful on node user
Jul 31 12:55:17 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.186s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:55:17 user nova-compute[72447]: DEBUG nova.network.neutron [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:55:17 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:55:18 user nova-compute[72447]: DEBUG nova.compute.manager [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:55:18 user nova-compute[72447]: INFO nova.virt.block_device [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Booting with volume e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b at /dev/vda
Jul 31 12:55:18 user nova-compute[72447]: DEBUG nova.policy [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10213ac072b24a899a4cc1403a601edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1be744ad5e14a4a8d1ca055e023e2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG os_brick.utils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cdae1e-438d-4d4d-922e-61e9114fa7a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1b43da-4490-4c11-bbc1-0d3d0f3c7848]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce9efa7-3447-4c8b-860e-ab340c9ed95f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[385d1754-42c8-4a40-9882-54f57b8812cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:55:18 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:55:18 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86a231c-4eb6-4034-bd1b-c441e6d62ffc]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG os_brick.utils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Updating existing volume attachment record: 4a6510d3-551b-4f70-b3fe-d04f2b49da36 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:55:18 user nova-compute[72447]: DEBUG nova.network.neutron [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Successfully created port: fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:55:19 user nova-compute[72447]: DEBUG nova.network.neutron [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Successfully updated port: fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:55:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "refresh_cache-9922cc93-204b-45dc-b1fd-89e56cadfe96" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:55:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquired lock "refresh_cache-9922cc93-204b-45dc-b1fd-89e56cadfe96" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:55:19 user nova-compute[72447]: DEBUG nova.network.neutron [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:55:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-fe372695-0046-4ae7-9560-7efe3bab3488 req-8b525ba0-fd43-453c-95c0-57b89c8471b6 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-changed-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:55:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-fe372695-0046-4ae7-9560-7efe3bab3488 req-8b525ba0-fd43-453c-95c0-57b89c8471b6 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Refreshing instance network info cache due to event network-changed-fb2c4f30-51ec-4db4-a314-1b67c0ae4930. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:55:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fe372695-0046-4ae7-9560-7efe3bab3488 req-8b525ba0-fd43-453c-95c0-57b89c8471b6 service nova] Acquiring lock "refresh_cache-9922cc93-204b-45dc-b1fd-89e56cadfe96" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:55:19 user nova-compute[72447]: DEBUG nova.network.neutron [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:55:20 user nova-compute[72447]: DEBUG nova.network.neutron [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Updating instance_info_cache with network_info: [{"id": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "address": "fa:16:3e:69:d7:b3", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2c4f30-51", "ovs_interfaceid": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:55:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Releasing lock "refresh_cache-9922cc93-204b-45dc-b1fd-89e56cadfe96" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:55:20 user nova-compute[72447]: DEBUG nova.compute.manager [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Instance network_info: |[{"id": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "address": "fa:16:3e:69:d7:b3", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2c4f30-51", "ovs_interfaceid": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:55:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fe372695-0046-4ae7-9560-7efe3bab3488 req-8b525ba0-fd43-453c-95c0-57b89c8471b6 service nova] Acquired lock "refresh_cache-9922cc93-204b-45dc-b1fd-89e56cadfe96" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:55:20 user nova-compute[72447]: DEBUG nova.network.neutron [req-fe372695-0046-4ae7-9560-7efe3bab3488 req-8b525ba0-fd43-453c-95c0-57b89c8471b6 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Refreshing network info cache for port fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:55:20 user nova-compute[72447]: DEBUG nova.network.neutron [req-fe372695-0046-4ae7-9560-7efe3bab3488 req-8b525ba0-fd43-453c-95c0-57b89c8471b6 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Updated VIF entry in instance network info cache for port fb2c4f30-51ec-4db4-a314-1b67c0ae4930. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:55:20 user nova-compute[72447]: DEBUG nova.network.neutron [req-fe372695-0046-4ae7-9560-7efe3bab3488 req-8b525ba0-fd43-453c-95c0-57b89c8471b6 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Updating instance_info_cache with network_info: [{"id": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "address": "fa:16:3e:69:d7:b3", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2c4f30-51", "ovs_interfaceid": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:55:20 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-fe372695-0046-4ae7-9560-7efe3bab3488 req-8b525ba0-fd43-453c-95c0-57b89c8471b6 service nova] Releasing lock "refresh_cache-9922cc93-204b-45dc-b1fd-89e56cadfe96" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:55:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:55:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:55:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:55:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Skipping network cache update for instance because it is Building. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 31 12:55:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:55:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:24 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.compute.manager [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:55:25 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Creating image(s)
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Ensure instance console log exists: /opt/stack/data/nova/instances/9922cc93-204b-45dc-b1fd-89e56cadfe96/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Start _get_guest_xml network_info=[{"id": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "address": "fa:16:3e:69:d7:b3", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2c4f30-51", "ovs_interfaceid": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '4a6510d3-551b-4f70-b3fe-d04f2b49da36', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGNRWUMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9922cc93-204b-45dc-b1fd-89e56cadfe96', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b', 'serial': 'e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:55:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:55:25 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGNRWUMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:55:25 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:55:25 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:55:25 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd02cd0b-d2d7-4a10-9078-c077e226cfdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:55:25 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0390eafa-4760-4a19-ada9-d588fec632b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b] added
Jul 31 12:55:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f985a90c-dea6-4008-a2dc-11d98055f334]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2965d1fd-d771-433b-8234-de098867a919]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGNRWUMv {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGNRWUMv" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[956eb94a-115d-4097-ac48-2de1ea82fb63]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sGNRWUMv'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc3208c-c4d7-4af6-8e9f-2f15fa49f771]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfefe19c-25b1-4ac2-8402-15d1ededf95c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:55:25 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:55:25 user nova-compute[72447]:  {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:55:25 user nova-compute[72447]: WARNING os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 12:55:25 user nova-compute[72447]: 
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7077385c-ea83-4b80-b3cb-448d4a20578f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260]
Jul 31 12:55:25 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260] successful.
Jul 31 12:55:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b6a6f7-1010-4bb0-9fe3-f0b788d375fd]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3970a93-819a-4e57-91b2-fec66856fca7]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 12:55:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 12:55:25 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eac09d1-1358-477e-beb2-424081403898]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:55:25 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGNRWUMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26435336339623264', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435336339623264', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1083532043',display_name='tempest-TestVolumeBootPattern-server-1083532043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1083532043',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTIXJM/n1bJxuEDDDqs1Br2sUf3hWacwSus7491JznvxM6xsK6CkH1UJVlrzhGwrpeG8mpf4cI4IpxRSGlXRn6Xht/5l7VHyR0vvgpBGdPB3gx9ApWXjg1DX5mHuILbKw==',key_name='tempest-TestVolumeBootPattern-275536139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-fgjx70mu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:55:18Z,user_data=None,user_id='10213ac072b24a899a4cc1403a601edf',uuid=9922cc93-204b-45dc-b1fd-89e56cadfe96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "address": "fa:16:3e:69:d7:b3", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2c4f30-51", "ovs_interfaceid": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "address": "fa:16:3e:69:d7:b3", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2c4f30-51", "ovs_interfaceid": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:d7:b3,bridge_name='br-int',has_traffic_filtering=True,id=fb2c4f30-51ec-4db4-a314-1b67c0ae4930,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2c4f30-51') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG nova.objects.instance [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lazy-loading 'pci_devices' on Instance uuid 9922cc93-204b-45dc-b1fd-89e56cadfe96 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:55:26 user nova-compute[72447]:   <uuid>9922cc93-204b-45dc-b1fd-89e56cadfe96</uuid>
Jul 31 12:55:26 user nova-compute[72447]:   <name>instance-00000031</name>
Jul 31 12:55:26 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:55:26 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:55:26 user nova-compute[72447]:   <metadata>
Jul 31 12:55:26 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:55:26 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:55:26 user nova-compute[72447]:       <nova:name>tempest-TestVolumeBootPattern-server-1083532043</nova:name>
Jul 31 12:55:26 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:55:25</nova:creationTime>
Jul 31 12:55:26 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:55:26 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:55:26 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:55:26 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:55:26 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:55:26 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:55:26 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:55:26 user nova-compute[72447]:       <nova:owner>
Jul 31 12:55:26 user nova-compute[72447]:         <nova:user uuid="10213ac072b24a899a4cc1403a601edf">tempest-TestVolumeBootPattern-37536115-project-member</nova:user>
Jul 31 12:55:26 user nova-compute[72447]:         <nova:project uuid="e1be744ad5e14a4a8d1ca055e023e2fb">tempest-TestVolumeBootPattern-37536115</nova:project>
Jul 31 12:55:26 user nova-compute[72447]:       </nova:owner>
Jul 31 12:55:26 user nova-compute[72447]:       <nova:ports>
Jul 31 12:55:26 user nova-compute[72447]:         <nova:port uuid="fb2c4f30-51ec-4db4-a314-1b67c0ae4930">
Jul 31 12:55:26 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 12:55:26 user nova-compute[72447]:         </nova:port>
Jul 31 12:55:26 user nova-compute[72447]:       </nova:ports>
Jul 31 12:55:26 user nova-compute[72447]:     </nova:instance>
Jul 31 12:55:26 user nova-compute[72447]:   </metadata>
Jul 31 12:55:26 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:55:26 user nova-compute[72447]:     <system>
Jul 31 12:55:26 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:55:26 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:55:26 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:55:26 user nova-compute[72447]:       <entry name="serial">9922cc93-204b-45dc-b1fd-89e56cadfe96</entry>
Jul 31 12:55:26 user nova-compute[72447]:       <entry name="uuid">9922cc93-204b-45dc-b1fd-89e56cadfe96</entry>
Jul 31 12:55:26 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:55:26 user nova-compute[72447]:     </system>
Jul 31 12:55:26 user nova-compute[72447]:   </sysinfo>
Jul 31 12:55:26 user nova-compute[72447]:   <os>
Jul 31 12:55:26 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:55:26 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:55:26 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:55:26 user nova-compute[72447]:   </os>
Jul 31 12:55:26 user nova-compute[72447]:   <features>
Jul 31 12:55:26 user nova-compute[72447]:     <acpi/>
Jul 31 12:55:26 user nova-compute[72447]:     <apic/>
Jul 31 12:55:26 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:55:26 user nova-compute[72447]:   </features>
Jul 31 12:55:26 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:55:26 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:55:26 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:55:26 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:55:26 user nova-compute[72447]:   </clock>
Jul 31 12:55:26 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:55:26 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:55:26 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:55:26 user nova-compute[72447]:   </cpu>
Jul 31 12:55:26 user nova-compute[72447]:   <devices>
Jul 31 12:55:26 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:55:26 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:55:26 user nova-compute[72447]:       <source dev="/dev/sdb"/>
Jul 31 12:55:26 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:55:26 user nova-compute[72447]:       <serial>e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b</serial>
Jul 31 12:55:26 user nova-compute[72447]:     </disk>
Jul 31 12:55:26 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:55:26 user nova-compute[72447]:       <mac address="fa:16:3e:69:d7:b3"/>
Jul 31 12:55:26 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:55:26 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:55:26 user nova-compute[72447]:       <target dev="tapfb2c4f30-51"/>
Jul 31 12:55:26 user nova-compute[72447]:     </interface>
Jul 31 12:55:26 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:55:26 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/9922cc93-204b-45dc-b1fd-89e56cadfe96/console.log" append="off"/>
Jul 31 12:55:26 user nova-compute[72447]:     </serial>
Jul 31 12:55:26 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:55:26 user nova-compute[72447]:     <video>
Jul 31 12:55:26 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:55:26 user nova-compute[72447]:     </video>
Jul 31 12:55:26 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:55:26 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:55:26 user nova-compute[72447]:     </rng>
Jul 31 12:55:26 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:55:26 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:55:26 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:55:26 user nova-compute[72447]:     </memballoon>
Jul 31 12:55:26 user nova-compute[72447]:   </devices>
Jul 31 12:55:26 user nova-compute[72447]: </domain>
Jul 31 12:55:26 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1083532043',display_name='tempest-TestVolumeBootPattern-server-1083532043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1083532043',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTIXJM/n1bJxuEDDDqs1Br2sUf3hWacwSus7491JznvxM6xsK6CkH1UJVlrzhGwrpeG8mpf4cI4IpxRSGlXRn6Xht/5l7VHyR0vvgpBGdPB3gx9ApWXjg1DX5mHuILbKw==',key_name='tempest-TestVolumeBootPattern-275536139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-fgjx70mu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:55:18Z,user_data=None,user_id='10213ac072b24a899a4cc1403a601edf',uuid=9922cc93-204b-45dc-b1fd-89e56cadfe96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "address": "fa:16:3e:69:d7:b3", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2c4f30-51", "ovs_interfaceid": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "address": "fa:16:3e:69:d7:b3", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2c4f30-51", "ovs_interfaceid": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:d7:b3,bridge_name='br-int',has_traffic_filtering=True,id=fb2c4f30-51ec-4db4-a314-1b67c0ae4930,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2c4f30-51') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG os_vif [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:d7:b3,bridge_name='br-int',has_traffic_filtering=True,id=fb2c4f30-51ec-4db4-a314-1b67c0ae4930,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2c4f30-51') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb2c4f30-51, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb2c4f30-51, col_values=(('external_ids', {'iface-id': 'fb2c4f30-51ec-4db4-a314-1b67c0ae4930', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:d7:b3', 'vm-uuid': '9922cc93-204b-45dc-b1fd-89e56cadfe96'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:26 user nova-compute[72447]: INFO os_vif [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:d7:b3,bridge_name='br-int',has_traffic_filtering=True,id=fb2c4f30-51ec-4db4-a314-1b67c0ae4930,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2c4f30-51')
Jul 31 12:55:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:55:26 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] No VIF found with MAC fa:16:3e:69:d7:b3, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:55:27 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:55:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-0295ea5e-fb68-4c83-9d53-407de59a4036 req-c74cfe6d-9973-48d9-9753-f6dd2cd69df8 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:55:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0295ea5e-fb68-4c83-9d53-407de59a4036 req-c74cfe6d-9973-48d9-9753-f6dd2cd69df8 service nova] Acquiring lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:55:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0295ea5e-fb68-4c83-9d53-407de59a4036 req-c74cfe6d-9973-48d9-9753-f6dd2cd69df8 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:55:28 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0295ea5e-fb68-4c83-9d53-407de59a4036 req-c74cfe6d-9973-48d9-9753-f6dd2cd69df8 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:55:28 user nova-compute[72447]: DEBUG nova.compute.manager [req-0295ea5e-fb68-4c83-9d53-407de59a4036 req-c74cfe6d-9973-48d9-9753-f6dd2cd69df8 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] No waiting events found dispatching network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:55:28 user nova-compute[72447]: WARNING nova.compute.manager [req-0295ea5e-fb68-4c83-9d53-407de59a4036 req-c74cfe6d-9973-48d9-9753-f6dd2cd69df8 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received unexpected event network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 for instance with vm_state building and task_state spawning.
Jul 31 12:55:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690808130.0691018, 9922cc93-204b-45dc-b1fd-89e56cadfe96 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:55:30 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] VM Resumed (Lifecycle Event)
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:55:30 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Instance spawned successfully.
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:55:30 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690808130.071038, 9922cc93-204b-45dc-b1fd-89e56cadfe96 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:55:30 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] VM Started (Lifecycle Event)
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:55:30 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:55:30 user nova-compute[72447]: INFO nova.compute.manager [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Took 4.93 seconds to spawn the instance on the hypervisor.
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:55:30 user nova-compute[72447]: INFO nova.compute.manager [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Took 12.59 seconds to build instance.
Jul 31 12:55:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-dc7140ff-89a2-42fd-97f2-be81bd13c7a3 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.683s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-855483c9-b1c7-4085-95ab-326521a7ed68 req-3c7e0994-0114-45ca-9678-39dad7679f62 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-855483c9-b1c7-4085-95ab-326521a7ed68 req-3c7e0994-0114-45ca-9678-39dad7679f62 service nova] Acquiring lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-855483c9-b1c7-4085-95ab-326521a7ed68 req-3c7e0994-0114-45ca-9678-39dad7679f62 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-855483c9-b1c7-4085-95ab-326521a7ed68 req-3c7e0994-0114-45ca-9678-39dad7679f62 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:55:30 user nova-compute[72447]: DEBUG nova.compute.manager [req-855483c9-b1c7-4085-95ab-326521a7ed68 req-3c7e0994-0114-45ca-9678-39dad7679f62 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] No waiting events found dispatching network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:55:30 user nova-compute[72447]: WARNING nova.compute.manager [req-855483c9-b1c7-4085-95ab-326521a7ed68 req-3c7e0994-0114-45ca-9678-39dad7679f62 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received unexpected event network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 for instance with vm_state active and task_state None.
Jul 31 12:55:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:31 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:55:31 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:55:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:55:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:55:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:55:31 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:55:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:55:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:32 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:55:32 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:55:32 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8887MB free_disk=25.145648956298828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:55:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:55:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:55:32 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 9922cc93-204b-45dc-b1fd-89e56cadfe96 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:55:32 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:55:32 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:55:32 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:55:32 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:55:32 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:55:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:55:33 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:55:34 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:55:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:55:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:55:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:55:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:55:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:55:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:55:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:55:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:56:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:56:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:56:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:56:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:56:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:56:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:56:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:56:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:56:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:56:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:56:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-9922cc93-204b-45dc-b1fd-89e56cadfe96" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:56:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-9922cc93-204b-45dc-b1fd-89e56cadfe96" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:56:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:56:22 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid 9922cc93-204b-45dc-b1fd-89e56cadfe96 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:56:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Updating instance_info_cache with network_info: [{"id": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "address": "fa:16:3e:69:d7:b3", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2c4f30-51", "ovs_interfaceid": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:56:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-9922cc93-204b-45dc-b1fd-89e56cadfe96" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:56:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:56:25 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:56:26 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:56:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:56:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:56:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:56:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:56:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:56:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:29 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:56:30 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:56:31 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:56:31 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:56:31 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=25.144973754882812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 9922cc93-204b-45dc-b1fd-89e56cadfe96 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:56:31 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:56:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:32 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:56:36 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:56:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:56:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:56:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:56:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:56:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:56:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:56:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:56:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:56:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:56:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:56:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:56:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:56:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:56:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:56:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:56:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:56:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:57:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:57:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:57:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:57:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:57:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-82469c75-cecd-464a-a453-8556e44a136b req-8cc80cd0-1735-41e7-bc46-53cd3a8c897e service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-changed-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:57:10 user nova-compute[72447]: DEBUG nova.compute.manager [req-82469c75-cecd-464a-a453-8556e44a136b req-8cc80cd0-1735-41e7-bc46-53cd3a8c897e service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Refreshing instance network info cache due to event network-changed-fb2c4f30-51ec-4db4-a314-1b67c0ae4930. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:57:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-82469c75-cecd-464a-a453-8556e44a136b req-8cc80cd0-1735-41e7-bc46-53cd3a8c897e service nova] Acquiring lock "refresh_cache-9922cc93-204b-45dc-b1fd-89e56cadfe96" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:57:10 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-82469c75-cecd-464a-a453-8556e44a136b req-8cc80cd0-1735-41e7-bc46-53cd3a8c897e service nova] Acquired lock "refresh_cache-9922cc93-204b-45dc-b1fd-89e56cadfe96" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:57:10 user nova-compute[72447]: DEBUG nova.network.neutron [req-82469c75-cecd-464a-a453-8556e44a136b req-8cc80cd0-1735-41e7-bc46-53cd3a8c897e service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Refreshing network info cache for port fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG nova.network.neutron [req-82469c75-cecd-464a-a453-8556e44a136b req-8cc80cd0-1735-41e7-bc46-53cd3a8c897e service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Updated VIF entry in instance network info cache for port fb2c4f30-51ec-4db4-a314-1b67c0ae4930. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG nova.network.neutron [req-82469c75-cecd-464a-a453-8556e44a136b req-8cc80cd0-1735-41e7-bc46-53cd3a8c897e service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Updating instance_info_cache with network_info: [{"id": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "address": "fa:16:3e:69:d7:b3", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2c4f30-51", "ovs_interfaceid": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "9922cc93-204b-45dc-b1fd-89e56cadfe96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:57:11 user nova-compute[72447]: INFO nova.compute.manager [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Terminating instance
Jul 31 12:57:11 user nova-compute[72447]: DEBUG nova.compute.manager [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-82469c75-cecd-464a-a453-8556e44a136b req-8cc80cd0-1735-41e7-bc46-53cd3a8c897e service nova] Releasing lock "refresh_cache-9922cc93-204b-45dc-b1fd-89e56cadfe96" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1373148-b46c-468e-9e82-a40d803536b7 req-a8a51ab9-ce30-4a2a-92c4-89e4474b6408 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-vif-unplugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1373148-b46c-468e-9e82-a40d803536b7 req-a8a51ab9-ce30-4a2a-92c4-89e4474b6408 service nova] Acquiring lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1373148-b46c-468e-9e82-a40d803536b7 req-a8a51ab9-ce30-4a2a-92c4-89e4474b6408 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b1373148-b46c-468e-9e82-a40d803536b7 req-a8a51ab9-ce30-4a2a-92c4-89e4474b6408 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1373148-b46c-468e-9e82-a40d803536b7 req-a8a51ab9-ce30-4a2a-92c4-89e4474b6408 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] No waiting events found dispatching network-vif-unplugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG nova.compute.manager [req-b1373148-b46c-468e-9e82-a40d803536b7 req-a8a51ab9-ce30-4a2a-92c4-89e4474b6408 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-vif-unplugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:12 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Instance destroyed successfully.
Jul 31 12:57:12 user nova-compute[72447]: DEBUG nova.objects.instance [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lazy-loading 'resources' on Instance uuid 9922cc93-204b-45dc-b1fd-89e56cadfe96 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1083532043',display_name='tempest-TestVolumeBootPattern-server-1083532043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1083532043',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTIXJM/n1bJxuEDDDqs1Br2sUf3hWacwSus7491JznvxM6xsK6CkH1UJVlrzhGwrpeG8mpf4cI4IpxRSGlXRn6Xht/5l7VHyR0vvgpBGdPB3gx9ApWXjg1DX5mHuILbKw==',key_name='tempest-TestVolumeBootPattern-275536139',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:55:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-fgjx70mu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:55:30Z,user_data=None,user_id='10213ac072b24a899a4cc1403a601edf',uuid=9922cc93-204b-45dc-b1fd-89e56cadfe96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "address": "fa:16:3e:69:d7:b3", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2c4f30-51", "ovs_interfaceid": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "address": "fa:16:3e:69:d7:b3", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb2c4f30-51", "ovs_interfaceid": "fb2c4f30-51ec-4db4-a314-1b67c0ae4930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:d7:b3,bridge_name='br-int',has_traffic_filtering=True,id=fb2c4f30-51ec-4db4-a314-1b67c0ae4930,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2c4f30-51') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_vif [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:d7:b3,bridge_name='br-int',has_traffic_filtering=True,id=fb2c4f30-51ec-4db4-a314-1b67c0ae4930,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2c4f30-51') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb2c4f30-51, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:57:12 user nova-compute[72447]: INFO os_vif [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:d7:b3,bridge_name='br-int',has_traffic_filtering=True,id=fb2c4f30-51ec-4db4-a314-1b67c0ae4930,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb2c4f30-51')
Jul 31 12:57:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGNRWUMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:57:12 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad48ab3f-7d8e-47e0-9ee5-6649ddd89ce3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d9cf9d-c44b-4a79-b290-23b4dbd84a5a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 12:57:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 12:57:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0679cd3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab99ba4-9d72-4639-a39c-1d85cefbcbf3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc96941c-8fd9-4b5f-85de-7402bcd8614d]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[797faf1d-91e6-4a90-8931-bbc4eeef09c5]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c230d-0885-4649-8dfa-25a82ccbf3db]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc035d2ed-d53c9b2d3b00d1b6', '/dev/disk/by-id/scsi-26435336339623264', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c035d2ed') {{(pid=83492) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[640b4327-b4c3-4bc8-a5f0-98fada81b776]: (4, None) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8d12ef-38e0-408c-9d20-4c336c036d24]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6790916-a6f6-4ed0-b6d7-3b7b3a2f6fec]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260]
Jul 31 12:57:12 user nova-compute[72447]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260] successful.
Jul 31 12:57:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[37199e47-79ad-4406-b7c1-a7ecc709c015]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== disconnect_volume: return (296ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 12:57:12 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Deleting instance files /opt/stack/data/nova/instances/9922cc93-204b-45dc-b1fd-89e56cadfe96_del
Jul 31 12:57:12 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Deletion of /opt/stack/data/nova/instances/9922cc93-204b-45dc-b1fd-89e56cadfe96_del complete
Jul 31 12:57:12 user nova-compute[72447]: INFO nova.compute.manager [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 31 12:57:12 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:57:13 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Took 0.87 seconds to deallocate network for instance.
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-3fcd7d11-8f30-4fe1-938c-b190b4472f14 req-eca72574-9540-4330-b7fd-60883b23f6bc service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-vif-deleted-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Acquiring lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] No waiting events found dispatching network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:57:13 user nova-compute[72447]: WARNING nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received unexpected event network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 for instance with vm_state active and task_state deleting.
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Acquiring lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] No waiting events found dispatching network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:57:13 user nova-compute[72447]: WARNING nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received unexpected event network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 for instance with vm_state active and task_state deleting.
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Acquiring lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] No waiting events found dispatching network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:57:13 user nova-compute[72447]: WARNING nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received unexpected event network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 for instance with vm_state active and task_state deleting.
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-vif-unplugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Acquiring lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] No waiting events found dispatching network-vif-unplugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-vif-unplugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received event network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Acquiring lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:57:13 user nova-compute[72447]: DEBUG nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] No waiting events found dispatching network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:57:13 user nova-compute[72447]: WARNING nova.compute.manager [req-5dbd026e-87f6-4c05-9e51-617c72a38bc8 req-708a6f9b-f7ac-4521-a1d7-c9194f2b0263 service nova] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Received unexpected event network-vif-plugged-fb2c4f30-51ec-4db4-a314-1b67c0ae4930 for instance with vm_state active and task_state deleting.
Jul 31 12:57:13 user nova-compute[72447]: INFO nova.compute.manager [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Took 0.70 seconds to detach 1 volumes for instance.
Jul 31 12:57:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:57:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:57:14 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:57:14 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:57:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:57:14 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Deleted allocations for instance 9922cc93-204b-45dc-b1fd-89e56cadfe96
Jul 31 12:57:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-129c106e-24a9-4d48-a5f2-a3a5b4c31fd7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "9922cc93-204b-45dc-b1fd-89e56cadfe96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.038s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:57:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:17 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:57:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:57:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 12:57:26 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:57:27 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690808232.0128324, 9922cc93-204b-45dc-b1fd-89e56cadfe96 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:57:27 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] VM Stopped (Lifecycle Event)
Jul 31 12:57:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-fb7ee1df-2a84-4664-8032-419ebd99fcd6 None None] [instance: 9922cc93-204b-45dc-b1fd-89e56cadfe96] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:57:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:27 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:29 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:57:32 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:57:32 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:57:32 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8929MB free_disk=25.143978118896484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:57:32 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:57:33 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:36 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:36 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:36 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72447) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 12:57:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:57:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:57:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:57:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:57:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:57:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:57:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:57:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:57:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:57:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:51 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:57:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 12:57:51 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] There are 0 instances to clean {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 12:57:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:57:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:58:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:58:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:58:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:58:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:58:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:58:02 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:58:02 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 12:58:03 user nova-compute[72447]: INFO nova.compute.claims [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Claim successful on node user
Jul 31 12:58:03 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 12:58:03 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 12:58:03 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 12:58:03 user nova-compute[72447]: INFO nova.virt.block_device [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Booting with volume e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b at /dev/vda
Jul 31 12:58:03 user nova-compute[72447]: DEBUG os_brick.utils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG nova.policy [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10213ac072b24a899a4cc1403a601edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1be744ad5e14a4a8d1ca055e023e2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7a9022-2612-4531-a4be-279ba30ab9bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42714f3-df03-4825-be12-b69f114f5ba0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0071d0b5-d1e9-4066-8f09-095ba61ce4ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d6ba4b-0c26-44f7-990d-1baaa67815e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 12:58:03 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 12:58:03 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b4f07f-495b-4be1-a208-bf4ba451897a]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG os_brick.utils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:58:03 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updating existing volume attachment record: 07d87b72-6549-4511-90aa-8dbfce054032 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 12:58:04 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Successfully created port: dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Successfully updated port: dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquired lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-34858569-9688-4d46-8768-e2e8102c46d6 req-0f3e9356-7acd-40cc-9914-3e3b89ef0a97 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Received event network-changed-dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG nova.compute.manager [req-34858569-9688-4d46-8768-e2e8102c46d6 req-0f3e9356-7acd-40cc-9914-3e3b89ef0a97 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Refreshing instance network info cache due to event network-changed-dd723fa4-bf32-4d63-a4cb-d65bb4064710. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-34858569-9688-4d46-8768-e2e8102c46d6 req-0f3e9356-7acd-40cc-9914-3e3b89ef0a97 service nova] Acquiring lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updating instance_info_cache with network_info: [{"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Releasing lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Instance network_info: |[{"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-34858569-9688-4d46-8768-e2e8102c46d6 req-0f3e9356-7acd-40cc-9914-3e3b89ef0a97 service nova] Acquired lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:58:05 user nova-compute[72447]: DEBUG nova.network.neutron [req-34858569-9688-4d46-8768-e2e8102c46d6 req-0f3e9356-7acd-40cc-9914-3e3b89ef0a97 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Refreshing network info cache for port dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:58:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-34858569-9688-4d46-8768-e2e8102c46d6 req-0f3e9356-7acd-40cc-9914-3e3b89ef0a97 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updated VIF entry in instance network info cache for port dd723fa4-bf32-4d63-a4cb-d65bb4064710. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:58:06 user nova-compute[72447]: DEBUG nova.network.neutron [req-34858569-9688-4d46-8768-e2e8102c46d6 req-0f3e9356-7acd-40cc-9914-3e3b89ef0a97 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updating instance_info_cache with network_info: [{"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:58:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-34858569-9688-4d46-8768-e2e8102c46d6 req-0f3e9356-7acd-40cc-9914-3e3b89ef0a97 service nova] Releasing lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:58:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:58:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:58:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 12:58:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:58:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 12:58:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 12:58:14 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Creating image(s)
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Ensure instance console log exists: /opt/stack/data/nova/instances/60be5c68-fbad-4bb0-a9f8-121d8e211dd8/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Start _get_guest_xml network_info=[{"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '07d87b72-6549-4511-90aa-8dbfce054032', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGNRWUMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60be5c68-fbad-4bb0-a9f8-121d8e211dd8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b', 'serial': 'e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 12:58:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:58:14 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 12:58:14 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGNRWUMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 12:58:15 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:58:15 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 12:58:15 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfef12bf-3f8d-4f20-a77e-6592f51bdde6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 12:58:15 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7957246-ccf5-4c31-b6ba-115a18741951]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b] added
Jul 31 12:58:15 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e06bd5-2ee7-4adc-b306-7e239411a134]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[772acb83-40c4-4cfb-80ee-f551f224764a]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGNRWUMv {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGNRWUMv" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[91105ee5-cdbd-438a-a3df-26b6a18e4751]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sGNRWUMv'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf93fdb-0bee-40b8-8777-324d57cc1007]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[948f1c41-d0f4-4fb6-94f6-b802db242e64]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:58:15 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 12:58:15 user nova-compute[72447]:  {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:58:15 user nova-compute[72447]: WARNING os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 12:58:15 user nova-compute[72447]: 
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5d9a47-388b-4b62-af91-73155114cbb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260]
Jul 31 12:58:15 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260] successful.
Jul 31 12:58:15 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa4120c-97ab-441b-8d6d-43c9ef927995]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3510213c-b24a-45e5-a742-b1dc2a5e851e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 12:58:15 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 12:58:15 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ec1fa3-7544-4b56-ba3c-ad332d4003e0]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 12:58:15 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGNRWUMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26435336339623264', 'path': '/dev/sdb'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435336339623264', 'path': '/dev/sdb'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1970181064',display_name='tempest-TestVolumeBootPattern-server-1970181064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1970181064',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTIXJM/n1bJxuEDDDqs1Br2sUf3hWacwSus7491JznvxM6xsK6CkH1UJVlrzhGwrpeG8mpf4cI4IpxRSGlXRn6Xht/5l7VHyR0vvgpBGdPB3gx9ApWXjg1DX5mHuILbKw==',key_name='tempest-TestVolumeBootPattern-275536139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-7r1lkpvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:58:03Z,user_data=None,user_id='10213ac072b24a899a4cc1403a601edf',uuid=60be5c68-fbad-4bb0-a9f8-121d8e211dd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:4f:33,bridge_name='br-int',has_traffic_filtering=True,id=dd723fa4-bf32-4d63-a4cb-d65bb4064710,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd723fa4-bf') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG nova.objects.instance [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lazy-loading 'pci_devices' on Instance uuid 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] End _get_guest_xml xml=<domain type="kvm">
Jul 31 12:58:16 user nova-compute[72447]:   <uuid>60be5c68-fbad-4bb0-a9f8-121d8e211dd8</uuid>
Jul 31 12:58:16 user nova-compute[72447]:   <name>instance-00000032</name>
Jul 31 12:58:16 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 12:58:16 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 12:58:16 user nova-compute[72447]:   <metadata>
Jul 31 12:58:16 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 12:58:16 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 12:58:16 user nova-compute[72447]:       <nova:name>tempest-TestVolumeBootPattern-server-1970181064</nova:name>
Jul 31 12:58:16 user nova-compute[72447]:       <nova:creationTime>2023-07-31 12:58:14</nova:creationTime>
Jul 31 12:58:16 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 12:58:16 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 12:58:16 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 12:58:16 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 12:58:16 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 12:58:16 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 12:58:16 user nova-compute[72447]:       </nova:flavor>
Jul 31 12:58:16 user nova-compute[72447]:       <nova:owner>
Jul 31 12:58:16 user nova-compute[72447]:         <nova:user uuid="10213ac072b24a899a4cc1403a601edf">tempest-TestVolumeBootPattern-37536115-project-member</nova:user>
Jul 31 12:58:16 user nova-compute[72447]:         <nova:project uuid="e1be744ad5e14a4a8d1ca055e023e2fb">tempest-TestVolumeBootPattern-37536115</nova:project>
Jul 31 12:58:16 user nova-compute[72447]:       </nova:owner>
Jul 31 12:58:16 user nova-compute[72447]:       <nova:ports>
Jul 31 12:58:16 user nova-compute[72447]:         <nova:port uuid="dd723fa4-bf32-4d63-a4cb-d65bb4064710">
Jul 31 12:58:16 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 12:58:16 user nova-compute[72447]:         </nova:port>
Jul 31 12:58:16 user nova-compute[72447]:       </nova:ports>
Jul 31 12:58:16 user nova-compute[72447]:     </nova:instance>
Jul 31 12:58:16 user nova-compute[72447]:   </metadata>
Jul 31 12:58:16 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 12:58:16 user nova-compute[72447]:     <system>
Jul 31 12:58:16 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 12:58:16 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 12:58:16 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 12:58:16 user nova-compute[72447]:       <entry name="serial">60be5c68-fbad-4bb0-a9f8-121d8e211dd8</entry>
Jul 31 12:58:16 user nova-compute[72447]:       <entry name="uuid">60be5c68-fbad-4bb0-a9f8-121d8e211dd8</entry>
Jul 31 12:58:16 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 12:58:16 user nova-compute[72447]:     </system>
Jul 31 12:58:16 user nova-compute[72447]:   </sysinfo>
Jul 31 12:58:16 user nova-compute[72447]:   <os>
Jul 31 12:58:16 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 12:58:16 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 12:58:16 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 12:58:16 user nova-compute[72447]:   </os>
Jul 31 12:58:16 user nova-compute[72447]:   <features>
Jul 31 12:58:16 user nova-compute[72447]:     <acpi/>
Jul 31 12:58:16 user nova-compute[72447]:     <apic/>
Jul 31 12:58:16 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 12:58:16 user nova-compute[72447]:   </features>
Jul 31 12:58:16 user nova-compute[72447]:   <clock offset="utc">
Jul 31 12:58:16 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 12:58:16 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 12:58:16 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 12:58:16 user nova-compute[72447]:   </clock>
Jul 31 12:58:16 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 12:58:16 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 12:58:16 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 12:58:16 user nova-compute[72447]:   </cpu>
Jul 31 12:58:16 user nova-compute[72447]:   <devices>
Jul 31 12:58:16 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 12:58:16 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 12:58:16 user nova-compute[72447]:       <source dev="/dev/sdb"/>
Jul 31 12:58:16 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 12:58:16 user nova-compute[72447]:       <serial>e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b</serial>
Jul 31 12:58:16 user nova-compute[72447]:     </disk>
Jul 31 12:58:16 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 12:58:16 user nova-compute[72447]:       <mac address="fa:16:3e:7e:4f:33"/>
Jul 31 12:58:16 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:58:16 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 12:58:16 user nova-compute[72447]:       <target dev="tapdd723fa4-bf"/>
Jul 31 12:58:16 user nova-compute[72447]:     </interface>
Jul 31 12:58:16 user nova-compute[72447]:     <serial type="pty">
Jul 31 12:58:16 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/60be5c68-fbad-4bb0-a9f8-121d8e211dd8/console.log" append="off"/>
Jul 31 12:58:16 user nova-compute[72447]:     </serial>
Jul 31 12:58:16 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 12:58:16 user nova-compute[72447]:     <video>
Jul 31 12:58:16 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 12:58:16 user nova-compute[72447]:     </video>
Jul 31 12:58:16 user nova-compute[72447]:     <rng model="virtio">
Jul 31 12:58:16 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 12:58:16 user nova-compute[72447]:     </rng>
Jul 31 12:58:16 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 12:58:16 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 12:58:16 user nova-compute[72447]:       <stats period="10"/>
Jul 31 12:58:16 user nova-compute[72447]:     </memballoon>
Jul 31 12:58:16 user nova-compute[72447]:   </devices>
Jul 31 12:58:16 user nova-compute[72447]: </domain>
Jul 31 12:58:16 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1970181064',display_name='tempest-TestVolumeBootPattern-server-1970181064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1970181064',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTIXJM/n1bJxuEDDDqs1Br2sUf3hWacwSus7491JznvxM6xsK6CkH1UJVlrzhGwrpeG8mpf4cI4IpxRSGlXRn6Xht/5l7VHyR0vvgpBGdPB3gx9ApWXjg1DX5mHuILbKw==',key_name='tempest-TestVolumeBootPattern-275536139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-7r1lkpvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T12:58:03Z,user_data=None,user_id='10213ac072b24a899a4cc1403a601edf',uuid=60be5c68-fbad-4bb0-a9f8-121d8e211dd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:4f:33,bridge_name='br-int',has_traffic_filtering=True,id=dd723fa4-bf32-4d63-a4cb-d65bb4064710,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd723fa4-bf') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG os_vif [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:4f:33,bridge_name='br-int',has_traffic_filtering=True,id=dd723fa4-bf32-4d63-a4cb-d65bb4064710,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd723fa4-bf') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd723fa4-bf, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd723fa4-bf, col_values=(('external_ids', {'iface-id': 'dd723fa4-bf32-4d63-a4cb-d65bb4064710', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:4f:33', 'vm-uuid': '60be5c68-fbad-4bb0-a9f8-121d8e211dd8'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:16 user nova-compute[72447]: INFO os_vif [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:4f:33,bridge_name='br-int',has_traffic_filtering=True,id=dd723fa4-bf32-4d63-a4cb-d65bb4064710,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd723fa4-bf')
Jul 31 12:58:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 12:58:16 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] No VIF found with MAC fa:16:3e:7e:4f:33, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 12:58:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-482580ee-03d5-4852-b105-bb22c7ef3efe req-05992ba6-b320-4b7e-952e-19a12b8dbb4f service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Received event network-vif-plugged-dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:58:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-482580ee-03d5-4852-b105-bb22c7ef3efe req-05992ba6-b320-4b7e-952e-19a12b8dbb4f service nova] Acquiring lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:58:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-482580ee-03d5-4852-b105-bb22c7ef3efe req-05992ba6-b320-4b7e-952e-19a12b8dbb4f service nova] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:58:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-482580ee-03d5-4852-b105-bb22c7ef3efe req-05992ba6-b320-4b7e-952e-19a12b8dbb4f service nova] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:58:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-482580ee-03d5-4852-b105-bb22c7ef3efe req-05992ba6-b320-4b7e-952e-19a12b8dbb4f service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] No waiting events found dispatching network-vif-plugged-dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:58:17 user nova-compute[72447]: WARNING nova.compute.manager [req-482580ee-03d5-4852-b105-bb22c7ef3efe req-05992ba6-b320-4b7e-952e-19a12b8dbb4f service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Received unexpected event network-vif-plugged-dd723fa4-bf32-4d63-a4cb-d65bb4064710 for instance with vm_state building and task_state spawning.
Jul 31 12:58:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690808299.767054, 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:58:19 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] VM Resumed (Lifecycle Event)
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 12:58:19 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Instance spawned successfully.
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 12:58:19 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690808299.7716143, 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 12:58:19 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] VM Started (Lifecycle Event)
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 12:58:19 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 12:58:19 user nova-compute[72447]: INFO nova.compute.manager [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Took 4.90 seconds to spawn the instance on the hypervisor.
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.compute.manager [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 12:58:19 user nova-compute[72447]: INFO nova.compute.manager [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Took 16.90 seconds to build instance.
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-51ae61c6-92aa-442c-b154-7711e7df4785 req-14597566-803e-4b1b-bd0f-5d3544494a60 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Received event network-vif-plugged-dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-51ae61c6-92aa-442c-b154-7711e7df4785 req-14597566-803e-4b1b-bd0f-5d3544494a60 service nova] Acquiring lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-51ae61c6-92aa-442c-b154-7711e7df4785 req-14597566-803e-4b1b-bd0f-5d3544494a60 service nova] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-51ae61c6-92aa-442c-b154-7711e7df4785 req-14597566-803e-4b1b-bd0f-5d3544494a60 service nova] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:58:19 user nova-compute[72447]: DEBUG nova.compute.manager [req-51ae61c6-92aa-442c-b154-7711e7df4785 req-14597566-803e-4b1b-bd0f-5d3544494a60 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] No waiting events found dispatching network-vif-plugged-dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 12:58:19 user nova-compute[72447]: WARNING nova.compute.manager [req-51ae61c6-92aa-442c-b154-7711e7df4785 req-14597566-803e-4b1b-bd0f-5d3544494a60 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Received unexpected event network-vif-plugged-dd723fa4-bf32-4d63-a4cb-d65bb4064710 for instance with vm_state active and task_state None.
Jul 31 12:58:19 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-ac0aba00-ffa7-4de2-b61f-54ec895cb73a tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.003s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:58:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:58:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:58:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:58:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:58:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:58:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:58:22 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:58:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updating instance_info_cache with network_info: [{"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:58:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:58:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:58:26 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:58:26 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:58:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:58:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:58:30 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:58:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:58:33 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:58:33 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:58:34 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:58:34 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=25.142253875732422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing inventories for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating ProviderTree inventory for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing aggregate associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, aggregates: None {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing trait associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:58:34 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:58:35 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:58:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:58:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:38 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:58:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:42 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:58:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:50 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:58:55 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:58:55 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Triggering sync for uuid 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 {{(pid=72447) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 12:58:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:58:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:58:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:58:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:59:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:59:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:59:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:59:16 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:59:21 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:59:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:59:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 12:59:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 12:59:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:59:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:59:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 12:59:22 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 12:59:23 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updating instance_info_cache with network_info: [{"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:59:23 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 12:59:23 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 12:59:26 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:59:27 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:59:27 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 12:59:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:59:31 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:59:31 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:59:33 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:59:34 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:59:34 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:59:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:59:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:59:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:59:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 12:59:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 12:59:34 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:59:34 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 12:59:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8857MB free_disk=25.14160919189453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 12:59:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 12:59:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 12:59:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 12:59:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 12:59:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 12:59:35 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 12:59:35 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 12:59:35 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 12:59:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 12:59:36 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:59:36 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:59:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:59:41 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:59:44 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 12:59:46 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 12:59:51 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:59:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:59:55 user nova-compute[72447]: DEBUG nova.compute.manager [req-5370a3cb-86ad-4276-9333-9efdffb404e9 req-da6120a4-1eb1-485b-be18-fbded0b06163 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Received event network-changed-dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 12:59:55 user nova-compute[72447]: DEBUG nova.compute.manager [req-5370a3cb-86ad-4276-9333-9efdffb404e9 req-da6120a4-1eb1-485b-be18-fbded0b06163 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Refreshing instance network info cache due to event network-changed-dd723fa4-bf32-4d63-a4cb-d65bb4064710. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 12:59:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5370a3cb-86ad-4276-9333-9efdffb404e9 req-da6120a4-1eb1-485b-be18-fbded0b06163 service nova] Acquiring lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 12:59:55 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5370a3cb-86ad-4276-9333-9efdffb404e9 req-da6120a4-1eb1-485b-be18-fbded0b06163 service nova] Acquired lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 12:59:55 user nova-compute[72447]: DEBUG nova.network.neutron [req-5370a3cb-86ad-4276-9333-9efdffb404e9 req-da6120a4-1eb1-485b-be18-fbded0b06163 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Refreshing network info cache for port dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 12:59:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:59:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 12:59:56 user nova-compute[72447]: DEBUG nova.network.neutron [req-5370a3cb-86ad-4276-9333-9efdffb404e9 req-da6120a4-1eb1-485b-be18-fbded0b06163 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updated VIF entry in instance network info cache for port dd723fa4-bf32-4d63-a4cb-d65bb4064710. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 12:59:56 user nova-compute[72447]: DEBUG nova.network.neutron [req-5370a3cb-86ad-4276-9333-9efdffb404e9 req-da6120a4-1eb1-485b-be18-fbded0b06163 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updating instance_info_cache with network_info: [{"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 12:59:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-5370a3cb-86ad-4276-9333-9efdffb404e9 req-da6120a4-1eb1-485b-be18-fbded0b06163 service nova] Releasing lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 13:00:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:01 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "a491e098-5875-4e2e-9f7e-2991ec9081f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:00:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:00:04 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Starting instance... {{(pid=72447) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 13:00:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:00:04 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:00:04 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72447) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 13:00:04 user nova-compute[72447]: INFO nova.compute.claims [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Claim successful on node user
Jul 31 13:00:05 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Start building networks asynchronously for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Allocating IP information in the background. {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] allocate_for_instance() {{(pid=72447) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 13:00:05 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 13:00:05 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Start building block device mappings for instance. {{(pid=72447) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 13:00:05 user nova-compute[72447]: INFO nova.virt.block_device [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Booting with volume b8c04559-feb4-473b-9f52-eac9b4c8af71 at /dev/vda
Jul 31 13:00:05 user nova-compute[72447]: DEBUG nova.policy [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10213ac072b24a899a4cc1403a601edf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1be744ad5e14a4a8d1ca055e023e2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72447) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG os_brick.utils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fada0a-ea04-403b-a025-d36051aeebe2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8ae2cf71763f\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1d28eb-6327-4f41-854d-5b89b5c555c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5a3971-94fd-4339-947a-62052f43de7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab523bd4-4b3c-469b-9457-a9fea340cd7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Running cmd (subprocess): nvme version {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] 'nvme version' failed. Not Retrying. {{(pid=72447) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] nvme not present on system {{(pid=72447) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 13:00:05 user nova-compute[72447]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 13:00:05 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e565cd3b-2ae8-4bbb-a62b-53447410645b]: (4, '') {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72447) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.lightos [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] LIGHTOS: no hostnqn found. {{(pid=72447) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG os_brick.utils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8ae2cf71763f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG nova.virt.block_device [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Updating existing volume attachment record: f0115aeb-8d2e-4022-a34b-eb35af1a2247 {{(pid=72447) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:05 user nova-compute[72447]: DEBUG nova.network.neutron [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Successfully created port: a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 13:00:06 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Successfully updated port: a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 13:00:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 13:00:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquired lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 13:00:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Building network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 13:00:06 user nova-compute[72447]: DEBUG nova.network.neutron [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Instance cache missing network info. {{(pid=72447) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 13:00:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-6e69cf92-5a06-4be7-83ca-e9cccede82b5 req-bab02ea7-c450-4f51-a6d4-5f5a12e79d67 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Received event network-changed-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 13:00:06 user nova-compute[72447]: DEBUG nova.compute.manager [req-6e69cf92-5a06-4be7-83ca-e9cccede82b5 req-bab02ea7-c450-4f51-a6d4-5f5a12e79d67 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Refreshing instance network info cache due to event network-changed-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 13:00:06 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6e69cf92-5a06-4be7-83ca-e9cccede82b5 req-bab02ea7-c450-4f51-a6d4-5f5a12e79d67 service nova] Acquiring lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 13:00:07 user nova-compute[72447]: DEBUG nova.network.neutron [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Updating instance_info_cache with network_info: [{"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 13:00:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Releasing lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 13:00:07 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Instance network_info: |[{"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72447) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 13:00:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6e69cf92-5a06-4be7-83ca-e9cccede82b5 req-bab02ea7-c450-4f51-a6d4-5f5a12e79d67 service nova] Acquired lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 13:00:07 user nova-compute[72447]: DEBUG nova.network.neutron [req-6e69cf92-5a06-4be7-83ca-e9cccede82b5 req-bab02ea7-c450-4f51-a6d4-5f5a12e79d67 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Refreshing network info cache for port a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 13:00:07 user nova-compute[72447]: DEBUG nova.network.neutron [req-6e69cf92-5a06-4be7-83ca-e9cccede82b5 req-bab02ea7-c450-4f51-a6d4-5f5a12e79d67 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Updated VIF entry in instance network info cache for port a7db8eac-a45e-4cd3-86fc-b45a5f0035f5. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 13:00:07 user nova-compute[72447]: DEBUG nova.network.neutron [req-6e69cf92-5a06-4be7-83ca-e9cccede82b5 req-bab02ea7-c450-4f51-a6d4-5f5a12e79d67 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Updating instance_info_cache with network_info: [{"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 13:00:07 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-6e69cf92-5a06-4be7-83ca-e9cccede82b5 req-bab02ea7-c450-4f51-a6d4-5f5a12e79d67 service nova] Releasing lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 13:00:10 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:11 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Start spawning the instance on the hypervisor. {{(pid=72447) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Creating instance directory {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 13:00:12 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Creating image(s)
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Did not create local disks {{(pid=72447) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Ensure instance console log exists: /opt/stack/data/nova/instances/a491e098-5875-4e2e-9f7e-2991ec9081f7/console.log {{(pid=72447) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Start _get_guest_xml network_info=[{"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'f0115aeb-8d2e-4022-a34b-eb35af1a2247', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FcqdNyAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a491e098-5875-4e2e-9f7e-2991ec9081f7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8c04559-feb4-473b-9f52-eac9b4c8af71', 'serial': 'b8c04559-feb4-473b-9f52-eac9b4c8af71'}, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 13:00:12 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 13:00:12 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU controller missing on host. {{(pid=72447) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.host [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU controller found on host. {{(pid=72447) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72447) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T12:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flavor limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Image limits 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flavor pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Image pref 0:0:0 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72447) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Got 1 possible topologies {{(pid=72447) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.hardware [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72447) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Calling os-brick to attach iSCSI Volume {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FcqdNyAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 13:00:12 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 13:00:12 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 13:00:12 user nova-compute[72447]: INFO os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37f46d0-8736-43a2-a61d-11a22eacfbfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 13:00:12 user nova-compute[72447]:  {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --interface default --op new {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f9cb5d-c738-41e2-a5f9-9f0c3e34e6f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71] added\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71] added
Jul 31 13:00:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7806e626-3ad4-4994-9620-bba2c9eeb735]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadae044-4237-43a6-a648-db5062dfd8e9]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FcqdNyAf {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FcqdNyAf" returned: 0 in 0.017s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d565769-3954-4b1d-9415-aebe85efde36]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FcqdNyAf'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[901064ca-26f3-413e-8cfb-4b778c9ee8b2]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fce88e-48ba-4ad0-8f5a-84be7576dfe7]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 13:00:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 13:00:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --login {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfedb40b-4772-4a64-bcce-00730237311c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71, portal: 172.16.0.220,3260]
Jul 31 13:00:12 user nova-compute[72447]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71, portal: 172.16.0.220,3260] successful.
Jul 31 13:00:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5578d08-753a-451e-ad4f-28be3ee6a79d]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ed2f5b-0cea-4932-96f1-f744f45d5ed1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 13:00:12 user nova-compute[72447]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 (non-flash)
Jul 31 13:00:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 13:00:12 user nova-compute[72447]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 (non-flash)
Jul 31 13:00:12 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Connected to 172.16.0.220:3260 {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=72447) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72447) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 13:00:12 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:00:13 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:00:13 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62c8e3f-7294-4681-aa32-0de5171c809c]: (4, ('- - 0', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:00:13 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72447) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 13:00:13 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FcqdNyAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72447) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23162636631393734', 'path': '/dev/sdc'} {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162636631393734', 'path': '/dev/sdc'} {{(pid=72447) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T13:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-95953560',display_name='tempest-TestVolumeBootPattern-server-95953560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-95953560',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTIXJM/n1bJxuEDDDqs1Br2sUf3hWacwSus7491JznvxM6xsK6CkH1UJVlrzhGwrpeG8mpf4cI4IpxRSGlXRn6Xht/5l7VHyR0vvgpBGdPB3gx9ApWXjg1DX5mHuILbKw==',key_name='tempest-TestVolumeBootPattern-275536139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-723r01ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T13:00:05Z,user_data=None,user_id='10213ac072b24a899a4cc1403a601edf',uuid=a491e098-5875-4e2e-9f7e-2991ec9081f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72447) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:73:58,bridge_name='br-int',has_traffic_filtering=True,id=a7db8eac-a45e-4cd3-86fc-b45a5f0035f5,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7db8eac-a4') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG nova.objects.instance [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lazy-loading 'pci_devices' on Instance uuid a491e098-5875-4e2e-9f7e-2991ec9081f7 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] End _get_guest_xml xml=<domain type="kvm">
Jul 31 13:00:14 user nova-compute[72447]:   <uuid>a491e098-5875-4e2e-9f7e-2991ec9081f7</uuid>
Jul 31 13:00:14 user nova-compute[72447]:   <name>instance-00000033</name>
Jul 31 13:00:14 user nova-compute[72447]:   <memory>524288</memory>
Jul 31 13:00:14 user nova-compute[72447]:   <vcpu>1</vcpu>
Jul 31 13:00:14 user nova-compute[72447]:   <metadata>
Jul 31 13:00:14 user nova-compute[72447]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 13:00:14 user nova-compute[72447]:       <nova:package version="0.0.0"/>
Jul 31 13:00:14 user nova-compute[72447]:       <nova:name>tempest-TestVolumeBootPattern-server-95953560</nova:name>
Jul 31 13:00:14 user nova-compute[72447]:       <nova:creationTime>2023-07-31 13:00:12</nova:creationTime>
Jul 31 13:00:14 user nova-compute[72447]:       <nova:flavor name="m1.tiny">
Jul 31 13:00:14 user nova-compute[72447]:         <nova:memory>512</nova:memory>
Jul 31 13:00:14 user nova-compute[72447]:         <nova:disk>1</nova:disk>
Jul 31 13:00:14 user nova-compute[72447]:         <nova:swap>0</nova:swap>
Jul 31 13:00:14 user nova-compute[72447]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 13:00:14 user nova-compute[72447]:         <nova:vcpus>1</nova:vcpus>
Jul 31 13:00:14 user nova-compute[72447]:       </nova:flavor>
Jul 31 13:00:14 user nova-compute[72447]:       <nova:owner>
Jul 31 13:00:14 user nova-compute[72447]:         <nova:user uuid="10213ac072b24a899a4cc1403a601edf">tempest-TestVolumeBootPattern-37536115-project-member</nova:user>
Jul 31 13:00:14 user nova-compute[72447]:         <nova:project uuid="e1be744ad5e14a4a8d1ca055e023e2fb">tempest-TestVolumeBootPattern-37536115</nova:project>
Jul 31 13:00:14 user nova-compute[72447]:       </nova:owner>
Jul 31 13:00:14 user nova-compute[72447]:       <nova:ports>
Jul 31 13:00:14 user nova-compute[72447]:         <nova:port uuid="a7db8eac-a45e-4cd3-86fc-b45a5f0035f5">
Jul 31 13:00:14 user nova-compute[72447]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 13:00:14 user nova-compute[72447]:         </nova:port>
Jul 31 13:00:14 user nova-compute[72447]:       </nova:ports>
Jul 31 13:00:14 user nova-compute[72447]:     </nova:instance>
Jul 31 13:00:14 user nova-compute[72447]:   </metadata>
Jul 31 13:00:14 user nova-compute[72447]:   <sysinfo type="smbios">
Jul 31 13:00:14 user nova-compute[72447]:     <system>
Jul 31 13:00:14 user nova-compute[72447]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 13:00:14 user nova-compute[72447]:       <entry name="product">OpenStack Nova</entry>
Jul 31 13:00:14 user nova-compute[72447]:       <entry name="version">0.0.0</entry>
Jul 31 13:00:14 user nova-compute[72447]:       <entry name="serial">a491e098-5875-4e2e-9f7e-2991ec9081f7</entry>
Jul 31 13:00:14 user nova-compute[72447]:       <entry name="uuid">a491e098-5875-4e2e-9f7e-2991ec9081f7</entry>
Jul 31 13:00:14 user nova-compute[72447]:       <entry name="family">Virtual Machine</entry>
Jul 31 13:00:14 user nova-compute[72447]:     </system>
Jul 31 13:00:14 user nova-compute[72447]:   </sysinfo>
Jul 31 13:00:14 user nova-compute[72447]:   <os>
Jul 31 13:00:14 user nova-compute[72447]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 13:00:14 user nova-compute[72447]:     <boot dev="hd"/>
Jul 31 13:00:14 user nova-compute[72447]:     <smbios mode="sysinfo"/>
Jul 31 13:00:14 user nova-compute[72447]:   </os>
Jul 31 13:00:14 user nova-compute[72447]:   <features>
Jul 31 13:00:14 user nova-compute[72447]:     <acpi/>
Jul 31 13:00:14 user nova-compute[72447]:     <apic/>
Jul 31 13:00:14 user nova-compute[72447]:     <vmcoreinfo/>
Jul 31 13:00:14 user nova-compute[72447]:   </features>
Jul 31 13:00:14 user nova-compute[72447]:   <clock offset="utc">
Jul 31 13:00:14 user nova-compute[72447]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 13:00:14 user nova-compute[72447]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 13:00:14 user nova-compute[72447]:     <timer name="hpet" present="no"/>
Jul 31 13:00:14 user nova-compute[72447]:   </clock>
Jul 31 13:00:14 user nova-compute[72447]:   <cpu mode="custom" match="exact">
Jul 31 13:00:14 user nova-compute[72447]:     <model>Nehalem</model>
Jul 31 13:00:14 user nova-compute[72447]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 13:00:14 user nova-compute[72447]:   </cpu>
Jul 31 13:00:14 user nova-compute[72447]:   <devices>
Jul 31 13:00:14 user nova-compute[72447]:     <disk type="block" device="disk">
Jul 31 13:00:14 user nova-compute[72447]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 13:00:14 user nova-compute[72447]:       <source dev="/dev/sdc"/>
Jul 31 13:00:14 user nova-compute[72447]:       <target dev="vda" bus="virtio"/>
Jul 31 13:00:14 user nova-compute[72447]:       <serial>b8c04559-feb4-473b-9f52-eac9b4c8af71</serial>
Jul 31 13:00:14 user nova-compute[72447]:     </disk>
Jul 31 13:00:14 user nova-compute[72447]:     <interface type="ethernet">
Jul 31 13:00:14 user nova-compute[72447]:       <mac address="fa:16:3e:cb:73:58"/>
Jul 31 13:00:14 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 13:00:14 user nova-compute[72447]:       <mtu size="1442"/>
Jul 31 13:00:14 user nova-compute[72447]:       <target dev="tapa7db8eac-a4"/>
Jul 31 13:00:14 user nova-compute[72447]:     </interface>
Jul 31 13:00:14 user nova-compute[72447]:     <serial type="pty">
Jul 31 13:00:14 user nova-compute[72447]:       <log file="/opt/stack/data/nova/instances/a491e098-5875-4e2e-9f7e-2991ec9081f7/console.log" append="off"/>
Jul 31 13:00:14 user nova-compute[72447]:     </serial>
Jul 31 13:00:14 user nova-compute[72447]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 13:00:14 user nova-compute[72447]:     <video>
Jul 31 13:00:14 user nova-compute[72447]:       <model type="virtio"/>
Jul 31 13:00:14 user nova-compute[72447]:     </video>
Jul 31 13:00:14 user nova-compute[72447]:     <rng model="virtio">
Jul 31 13:00:14 user nova-compute[72447]:       <backend model="random">/dev/urandom</backend>
Jul 31 13:00:14 user nova-compute[72447]:     </rng>
Jul 31 13:00:14 user nova-compute[72447]:     <controller type="usb" index="0" model="none"/>
Jul 31 13:00:14 user nova-compute[72447]:     <memballoon model="virtio">
Jul 31 13:00:14 user nova-compute[72447]:       <stats period="10"/>
Jul 31 13:00:14 user nova-compute[72447]:     </memballoon>
Jul 31 13:00:14 user nova-compute[72447]:   </devices>
Jul 31 13:00:14 user nova-compute[72447]: </domain>
Jul 31 13:00:14 user nova-compute[72447]:  {{(pid=72447) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T13:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-95953560',display_name='tempest-TestVolumeBootPattern-server-95953560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-95953560',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTIXJM/n1bJxuEDDDqs1Br2sUf3hWacwSus7491JznvxM6xsK6CkH1UJVlrzhGwrpeG8mpf4cI4IpxRSGlXRn6Xht/5l7VHyR0vvgpBGdPB3gx9ApWXjg1DX5mHuILbKw==',key_name='tempest-TestVolumeBootPattern-275536139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-723r01ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T13:00:05Z,user_data=None,user_id='10213ac072b24a899a4cc1403a601edf',uuid=a491e098-5875-4e2e-9f7e-2991ec9081f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:73:58,bridge_name='br-int',has_traffic_filtering=True,id=a7db8eac-a45e-4cd3-86fc-b45a5f0035f5,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7db8eac-a4') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG os_vif [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:73:58,bridge_name='br-int',has_traffic_filtering=True,id=a7db8eac-a45e-4cd3-86fc-b45a5f0035f5,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7db8eac-a4') {{(pid=72447) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7db8eac-a4, may_exist=True, interface_attrs={}) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7db8eac-a4, col_values=(('external_ids', {'iface-id': 'a7db8eac-a45e-4cd3-86fc-b45a5f0035f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:73:58', 'vm-uuid': 'a491e098-5875-4e2e-9f7e-2991ec9081f7'}),), if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:14 user nova-compute[72447]: INFO os_vif [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:73:58,bridge_name='br-int',has_traffic_filtering=True,id=a7db8eac-a45e-4cd3-86fc-b45a5f0035f5,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7db8eac-a4')
Jul 31 13:00:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] No BDM found with device name vda, not building metadata. {{(pid=72447) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 13:00:14 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] No VIF found with MAC fa:16:3e:cb:73:58, not building metadata {{(pid=72447) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 13:00:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:15 user nova-compute[72447]: DEBUG nova.compute.manager [req-ac00805c-2d26-44e3-aa59-2ee86338179b req-be86cb7e-e4c2-447f-aff6-8aeaae9d95cf service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Received event network-vif-plugged-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 13:00:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ac00805c-2d26-44e3-aa59-2ee86338179b req-be86cb7e-e4c2-447f-aff6-8aeaae9d95cf service nova] Acquiring lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:00:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ac00805c-2d26-44e3-aa59-2ee86338179b req-be86cb7e-e4c2-447f-aff6-8aeaae9d95cf service nova] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:00:15 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-ac00805c-2d26-44e3-aa59-2ee86338179b req-be86cb7e-e4c2-447f-aff6-8aeaae9d95cf service nova] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:00:15 user nova-compute[72447]: DEBUG nova.compute.manager [req-ac00805c-2d26-44e3-aa59-2ee86338179b req-be86cb7e-e4c2-447f-aff6-8aeaae9d95cf service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] No waiting events found dispatching network-vif-plugged-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 13:00:15 user nova-compute[72447]: WARNING nova.compute.manager [req-ac00805c-2d26-44e3-aa59-2ee86338179b req-be86cb7e-e4c2-447f-aff6-8aeaae9d95cf service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Received unexpected event network-vif-plugged-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 for instance with vm_state building and task_state spawning.
Jul 31 13:00:15 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690808417.4418488, a491e098-5875-4e2e-9f7e-2991ec9081f7 => Resumed> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 13:00:17 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] VM Resumed (Lifecycle Event)
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Instance event wait completed in 0 seconds for  {{(pid=72447) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Guest created on hypervisor {{(pid=72447) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 13:00:17 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Instance spawned successfully.
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Found default for hw_cdrom_bus of ide {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Found default for hw_disk_bus of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Found default for hw_input_bus of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Found default for hw_pointer_model of None {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Found default for hw_video_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Found default for hw_vif_model of virtio {{(pid=72447) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 13:00:17 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.virt.driver [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] Emitting event <LifecycleEvent: 1690808417.4462287, a491e098-5875-4e2e-9f7e-2991ec9081f7 => Started> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 13:00:17 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] VM Started (Lifecycle Event)
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72447) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 13:00:17 user nova-compute[72447]: INFO nova.compute.manager [None req-b56da633-f97b-4cf7-96ec-131555b37b42 None None] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 13:00:17 user nova-compute[72447]: INFO nova.compute.manager [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Took 4.87 seconds to spawn the instance on the hypervisor.
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.compute.manager [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 13:00:17 user nova-compute[72447]: INFO nova.compute.manager [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Took 12.70 seconds to build instance.
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-b034b9ce-3eb3-42a1-aef2-8ecaa22c32a2 req-1ee93e9b-854c-4476-81c7-5536c47d94a8 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Received event network-vif-plugged-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b034b9ce-3eb3-42a1-aef2-8ecaa22c32a2 req-1ee93e9b-854c-4476-81c7-5536c47d94a8 service nova] Acquiring lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b034b9ce-3eb3-42a1-aef2-8ecaa22c32a2 req-1ee93e9b-854c-4476-81c7-5536c47d94a8 service nova] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-b034b9ce-3eb3-42a1-aef2-8ecaa22c32a2 req-1ee93e9b-854c-4476-81c7-5536c47d94a8 service nova] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:00:17 user nova-compute[72447]: DEBUG nova.compute.manager [req-b034b9ce-3eb3-42a1-aef2-8ecaa22c32a2 req-1ee93e9b-854c-4476-81c7-5536c47d94a8 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] No waiting events found dispatching network-vif-plugged-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 13:00:17 user nova-compute[72447]: WARNING nova.compute.manager [req-b034b9ce-3eb3-42a1-aef2-8ecaa22c32a2 req-1ee93e9b-854c-4476-81c7-5536c47d94a8 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Received unexpected event network-vif-plugged-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 for instance with vm_state active and task_state None.
Jul 31 13:00:17 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-c4b31992-3aab-4f89-8c42-9ca1040cdec6 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.818s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:00:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:20 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:00:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 13:00:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 13:00:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 13:00:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 13:00:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 13:00:22 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 13:00:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updating instance_info_cache with network_info: [{"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 13:00:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 13:00:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 13:00:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:00:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:00:29 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:00:29 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 13:00:30 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:32 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 13:00:34 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 13:00:34 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 13:00:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8648MB free_disk=25.131919860839844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance a491e098-5875-4e2e-9f7e-2991ec9081f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 13:00:34 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 13:00:35 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 13:00:35 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 13:00:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:00:35 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:36 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:00:36 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:00:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:40 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:00:40 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:44 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:00:45 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:00:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:00:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:01:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:01:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 13:01:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:01:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:01:04 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:09 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:01:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 13:01:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:01:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:01:14 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:19 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:01:22 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:01:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 13:01:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 13:01:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 13:01:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 13:01:22 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Updating instance_info_cache with network_info: [{"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 13:01:22 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 13:01:22 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 13:01:24 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:01:29 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:30 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:01:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 13:01:34 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 13:01:34 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 13:01:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=25.131263732910156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance a491e098-5875-4e2e-9f7e-2991ec9081f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 13:01:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:01:35 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:01:35 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:01:37 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:01:39 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:01:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:01:44 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:01:44 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:01:49 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:54 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:01:55 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-a8cfb2d0-e4c8-425e-8e0c-2fd8a8d38ea4 req-0e11abbb-cbe7-4e48-be76-89dc0ad856e8 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Received event network-changed-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 13:01:56 user nova-compute[72447]: DEBUG nova.compute.manager [req-a8cfb2d0-e4c8-425e-8e0c-2fd8a8d38ea4 req-0e11abbb-cbe7-4e48-be76-89dc0ad856e8 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Refreshing instance network info cache due to event network-changed-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 13:01:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a8cfb2d0-e4c8-425e-8e0c-2fd8a8d38ea4 req-0e11abbb-cbe7-4e48-be76-89dc0ad856e8 service nova] Acquiring lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 13:01:56 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a8cfb2d0-e4c8-425e-8e0c-2fd8a8d38ea4 req-0e11abbb-cbe7-4e48-be76-89dc0ad856e8 service nova] Acquired lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 13:01:56 user nova-compute[72447]: DEBUG nova.network.neutron [req-a8cfb2d0-e4c8-425e-8e0c-2fd8a8d38ea4 req-0e11abbb-cbe7-4e48-be76-89dc0ad856e8 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Refreshing network info cache for port a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG nova.network.neutron [req-a8cfb2d0-e4c8-425e-8e0c-2fd8a8d38ea4 req-0e11abbb-cbe7-4e48-be76-89dc0ad856e8 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Updated VIF entry in instance network info cache for port a7db8eac-a45e-4cd3-86fc-b45a5f0035f5. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG nova.network.neutron [req-a8cfb2d0-e4c8-425e-8e0c-2fd8a8d38ea4 req-0e11abbb-cbe7-4e48-be76-89dc0ad856e8 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Updating instance_info_cache with network_info: [{"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-a8cfb2d0-e4c8-425e-8e0c-2fd8a8d38ea4 req-0e11abbb-cbe7-4e48-be76-89dc0ad856e8 service nova] Releasing lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-1deab086-fe7a-44b2-9914-05d75f20892a req-d57567cd-0675-43dd-9cce-b5ae7f378348 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Received event network-changed-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-1deab086-fe7a-44b2-9914-05d75f20892a req-d57567cd-0675-43dd-9cce-b5ae7f378348 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Refreshing instance network info cache due to event network-changed-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1deab086-fe7a-44b2-9914-05d75f20892a req-d57567cd-0675-43dd-9cce-b5ae7f378348 service nova] Acquiring lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1deab086-fe7a-44b2-9914-05d75f20892a req-d57567cd-0675-43dd-9cce-b5ae7f378348 service nova] Acquired lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG nova.network.neutron [req-1deab086-fe7a-44b2-9914-05d75f20892a req-d57567cd-0675-43dd-9cce-b5ae7f378348 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Refreshing network info cache for port a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "a491e098-5875-4e2e-9f7e-2991ec9081f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:01:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:01:57 user nova-compute[72447]: INFO nova.compute.manager [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Terminating instance
Jul 31 13:01:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG nova.compute.manager [req-674171da-9f67-4146-be8e-0b4f052aefa6 req-d3aa2cd7-cf0e-440f-84e3-a0a797e80c37 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Received event network-vif-unplugged-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-674171da-9f67-4146-be8e-0b4f052aefa6 req-d3aa2cd7-cf0e-440f-84e3-a0a797e80c37 service nova] Acquiring lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-674171da-9f67-4146-be8e-0b4f052aefa6 req-d3aa2cd7-cf0e-440f-84e3-a0a797e80c37 service nova] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-674171da-9f67-4146-be8e-0b4f052aefa6 req-d3aa2cd7-cf0e-440f-84e3-a0a797e80c37 service nova] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG nova.compute.manager [req-674171da-9f67-4146-be8e-0b4f052aefa6 req-d3aa2cd7-cf0e-440f-84e3-a0a797e80c37 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] No waiting events found dispatching network-vif-unplugged-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG nova.compute.manager [req-674171da-9f67-4146-be8e-0b4f052aefa6 req-d3aa2cd7-cf0e-440f-84e3-a0a797e80c37 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Received event network-vif-unplugged-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG nova.network.neutron [req-1deab086-fe7a-44b2-9914-05d75f20892a req-d57567cd-0675-43dd-9cce-b5ae7f378348 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Updated VIF entry in instance network info cache for port a7db8eac-a45e-4cd3-86fc-b45a5f0035f5. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG nova.network.neutron [req-1deab086-fe7a-44b2-9914-05d75f20892a req-d57567cd-0675-43dd-9cce-b5ae7f378348 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Updating instance_info_cache with network_info: [{"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-1deab086-fe7a-44b2-9914-05d75f20892a req-d57567cd-0675-43dd-9cce-b5ae7f378348 service nova] Releasing lock "refresh_cache-a491e098-5875-4e2e-9f7e-2991ec9081f7" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 13:01:58 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Instance destroyed successfully.
Jul 31 13:01:58 user nova-compute[72447]: DEBUG nova.objects.instance [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lazy-loading 'resources' on Instance uuid a491e098-5875-4e2e-9f7e-2991ec9081f7 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T13:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-95953560',display_name='tempest-TestVolumeBootPattern-server-95953560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-95953560',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTIXJM/n1bJxuEDDDqs1Br2sUf3hWacwSus7491JznvxM6xsK6CkH1UJVlrzhGwrpeG8mpf4cI4IpxRSGlXRn6Xht/5l7VHyR0vvgpBGdPB3gx9ApWXjg1DX5mHuILbKw==',key_name='tempest-TestVolumeBootPattern-275536139',keypairs=<?>,launch_index=0,launched_at=2023-07-31T13:00:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-723r01ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T13:00:18Z,user_data=None,user_id='10213ac072b24a899a4cc1403a601edf',uuid=a491e098-5875-4e2e-9f7e-2991ec9081f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "address": "fa:16:3e:cb:73:58", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7db8eac-a4", "ovs_interfaceid": "a7db8eac-a45e-4cd3-86fc-b45a5f0035f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:73:58,bridge_name='br-int',has_traffic_filtering=True,id=a7db8eac-a45e-4cd3-86fc-b45a5f0035f5,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7db8eac-a4') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_vif [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:73:58,bridge_name='br-int',has_traffic_filtering=True,id=a7db8eac-a45e-4cd3-86fc-b45a5f0035f5,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7db8eac-a4') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7db8eac-a4, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:01:58 user nova-compute[72447]: INFO os_vif [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:73:58,bridge_name='br-int',has_traffic_filtering=True,id=a7db8eac-a45e-4cd3-86fc-b45a5f0035f5,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7db8eac-a4')
Jul 31 13:01:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FcqdNyAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 13:01:58 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d9d4d4-5ffd-4d79-92ca-ef65a7627eac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[553a58bc-516a-464f-90ad-8f647329b520]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 13:01:58 user nova-compute[72447]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 (non-flash)
Jul 31 13:01:58 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 13:01:58 user nova-compute[72447]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 (non-flash)
Jul 31 13:01:58 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f064875d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71'): ({'sdc'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Removing single pathed devices sdc {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[88988511-7cec-49fe-913a-f4198806971f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05abcb9-1be0-46ec-81c0-60710e809798]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flushing IO for device /dev/sdc {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb5427b-2d19-49b9-917c-fb4d3fe8e465]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9ff5ef-0617-4563-9b66-7e3d93c11699]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] SCSI volumes sdc have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2ab3de31',) {{(pid=83492) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bdaf11-80a7-464d-9453-4f023fab6bba]: (4, None) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d83209-c00e-4207-8d71-6e42631fe936]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:01:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f57a150-ee57-4aaf-8673-e4d5c53fcda6]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71, portal: 172.16.0.220,3260]
Jul 31 13:01:59 user nova-compute[72447]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71, portal: 172.16.0.220,3260] successful.
Jul 31 13:01:59 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8c04559-feb4-473b-9f52-eac9b4c8af71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e14c3b-b78b-4fe8-855a-d746a4ed0ea0]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== disconnect_volume: return (272ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 13:01:59 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Deleting instance files /opt/stack/data/nova/instances/a491e098-5875-4e2e-9f7e-2991ec9081f7_del
Jul 31 13:01:59 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Deletion of /opt/stack/data/nova/instances/a491e098-5875-4e2e-9f7e-2991ec9081f7_del complete
Jul 31 13:01:59 user nova-compute[72447]: INFO nova.compute.manager [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Took 1.11 seconds to destroy the instance on the hypervisor.
Jul 31 13:01:59 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 13:01:59 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 13:01:59 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Took 0.72 seconds to deallocate network for instance.
Jul 31 13:02:00 user nova-compute[72447]: DEBUG nova.compute.manager [req-94db7fd1-a918-4295-8f15-3368b0fbfc7a req-812476ff-de4c-46d1-a96b-86c185c5e6d1 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Received event network-vif-plugged-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 13:02:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-94db7fd1-a918-4295-8f15-3368b0fbfc7a req-812476ff-de4c-46d1-a96b-86c185c5e6d1 service nova] Acquiring lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:02:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-94db7fd1-a918-4295-8f15-3368b0fbfc7a req-812476ff-de4c-46d1-a96b-86c185c5e6d1 service nova] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:02:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-94db7fd1-a918-4295-8f15-3368b0fbfc7a req-812476ff-de4c-46d1-a96b-86c185c5e6d1 service nova] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:02:00 user nova-compute[72447]: DEBUG nova.compute.manager [req-94db7fd1-a918-4295-8f15-3368b0fbfc7a req-812476ff-de4c-46d1-a96b-86c185c5e6d1 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] No waiting events found dispatching network-vif-plugged-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 13:02:00 user nova-compute[72447]: WARNING nova.compute.manager [req-94db7fd1-a918-4295-8f15-3368b0fbfc7a req-812476ff-de4c-46d1-a96b-86c185c5e6d1 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Received unexpected event network-vif-plugged-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 for instance with vm_state active and task_state deleting.
Jul 31 13:02:00 user nova-compute[72447]: DEBUG nova.compute.manager [req-94db7fd1-a918-4295-8f15-3368b0fbfc7a req-812476ff-de4c-46d1-a96b-86c185c5e6d1 service nova] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Received event network-vif-deleted-a7db8eac-a45e-4cd3-86fc-b45a5f0035f5 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 13:02:00 user nova-compute[72447]: INFO nova.compute.manager [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Took 0.82 seconds to detach 1 volumes for instance.
Jul 31 13:02:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:02:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:02:00 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 13:02:00 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 13:02:00 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:02:00 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Deleted allocations for instance a491e098-5875-4e2e-9f7e-2991ec9081f7
Jul 31 13:02:00 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-4c8329e9-7f11-4883-bfe0-5b758d71c25d tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "a491e098-5875-4e2e-9f7e-2991ec9081f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:02:03 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:08 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:13 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690808518.7344832, a491e098-5875-4e2e-9f7e-2991ec9081f7 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 13:02:13 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] VM Stopped (Lifecycle Event)
Jul 31 13:02:13 user nova-compute[72447]: DEBUG nova.compute.manager [None req-a8be0702-537c-4d18-984e-1e32267fdfe4 None None] [instance: a491e098-5875-4e2e-9f7e-2991ec9081f7] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 13:02:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:02:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 13:02:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:02:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:02:13 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:18 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:02:23 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:24 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:02:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 13:02:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 13:02:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 13:02:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquired lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 13:02:24 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Forcefully refreshing network info cache for instance {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 13:02:24 user nova-compute[72447]: DEBUG nova.objects.instance [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lazy-loading 'info_cache' on Instance uuid 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 13:02:24 user nova-compute[72447]: DEBUG nova.network.neutron [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updating instance_info_cache with network_info: [{"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 13:02:24 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Releasing lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 13:02:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updated the network info_cache for instance {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 13:02:28 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:02:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:02:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 13:02:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:02:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:02:28 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:30 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:02:30 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 13:02:30 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:02:33 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:34 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:02:34 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:02:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:02:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:02:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:02:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 13:02:34 user nova-compute[72447]: DEBUG nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72447) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 13:02:34 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 13:02:34 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 13:02:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8823MB free_disk=25.13034439086914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 13:02:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:02:34 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:02:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Instance 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72447) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 13:02:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 13:02:34 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 13:02:35 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 13:02:35 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 13:02:35 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 13:02:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:02:36 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:02:36 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72447) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 13:02:37 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:02:38 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:02:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:02:41 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:02:43 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:02:46 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:02:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:02:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 13:02:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:02:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:02:53 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:02:55 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:02:55 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Cleaning up deleted instances {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 13:02:55 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] There are 0 instances to clean {{(pid=72447) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-0f519bda-958a-401c-b819-d0faeb1b8a41 req-008e6629-b09b-4d48-8cce-2eacfe4120a6 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Received event network-changed-dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG nova.compute.manager [req-0f519bda-958a-401c-b819-d0faeb1b8a41 req-008e6629-b09b-4d48-8cce-2eacfe4120a6 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Refreshing instance network info cache due to event network-changed-dd723fa4-bf32-4d63-a4cb-d65bb4064710. {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0f519bda-958a-401c-b819-d0faeb1b8a41 req-008e6629-b09b-4d48-8cce-2eacfe4120a6 service nova] Acquiring lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0f519bda-958a-401c-b819-d0faeb1b8a41 req-008e6629-b09b-4d48-8cce-2eacfe4120a6 service nova] Acquired lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG nova.network.neutron [req-0f519bda-958a-401c-b819-d0faeb1b8a41 req-008e6629-b09b-4d48-8cce-2eacfe4120a6 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Refreshing network info cache for port dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:02:57 user nova-compute[72447]: INFO nova.compute.manager [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Terminating instance
Jul 31 13:02:57 user nova-compute[72447]: DEBUG nova.compute.manager [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Start destroying the instance on the hypervisor. {{(pid=72447) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG nova.network.neutron [req-0f519bda-958a-401c-b819-d0faeb1b8a41 req-008e6629-b09b-4d48-8cce-2eacfe4120a6 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updated VIF entry in instance network info cache for port dd723fa4-bf32-4d63-a4cb-d65bb4064710. {{(pid=72447) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG nova.network.neutron [req-0f519bda-958a-401c-b819-d0faeb1b8a41 req-008e6629-b09b-4d48-8cce-2eacfe4120a6 service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updating instance_info_cache with network_info: [{"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-0f519bda-958a-401c-b819-d0faeb1b8a41 req-008e6629-b09b-4d48-8cce-2eacfe4120a6 service nova] Releasing lock "refresh_cache-60be5c68-fbad-4bb0-a9f8-121d8e211dd8" {{(pid=72447) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:57 user nova-compute[72447]: INFO nova.virt.libvirt.driver [-] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Instance destroyed successfully.
Jul 31 13:02:57 user nova-compute[72447]: DEBUG nova.objects.instance [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lazy-loading 'resources' on Instance uuid 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 {{(pid=72447) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.vif [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T12:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1970181064',display_name='tempest-TestVolumeBootPattern-server-1970181064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1970181064',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTIXJM/n1bJxuEDDDqs1Br2sUf3hWacwSus7491JznvxM6xsK6CkH1UJVlrzhGwrpeG8mpf4cI4IpxRSGlXRn6Xht/5l7VHyR0vvgpBGdPB3gx9ApWXjg1DX5mHuILbKw==',key_name='tempest-TestVolumeBootPattern-275536139',keypairs=<?>,launch_index=0,launched_at=2023-07-31T12:58:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1be744ad5e14a4a8d1ca055e023e2fb',ramdisk_id='',reservation_id='r-7r1lkpvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-37536115',owner_user_name='tempest-TestVolumeBootPattern-37536115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T12:58:20Z,user_data=None,user_id='10213ac072b24a899a4cc1403a601edf',uuid=60be5c68-fbad-4bb0-a9f8-121d8e211dd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converting VIF {"id": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "address": "fa:16:3e:7e:4f:33", "network": {"id": "74eabb6e-443b-4974-812e-bbcfac0f1a7f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-203302096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1be744ad5e14a4a8d1ca055e023e2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd723fa4-bf", "ovs_interfaceid": "dd723fa4-bf32-4d63-a4cb-d65bb4064710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG nova.network.os_vif_util [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:4f:33,bridge_name='br-int',has_traffic_filtering=True,id=dd723fa4-bf32-4d63-a4cb-d65bb4064710,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd723fa4-bf') {{(pid=72447) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG os_vif [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:4f:33,bridge_name='br-int',has_traffic_filtering=True,id=dd723fa4-bf32-4d63-a4cb-d65bb4064710,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd723fa4-bf') {{(pid=72447) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd723fa4-bf, bridge=br-int, if_exists=True) {{(pid=72447) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:02:57 user nova-compute[72447]: INFO os_vif [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:4f:33,bridge_name='br-int',has_traffic_filtering=True,id=dd723fa4-bf32-4d63-a4cb-d65bb4064710,network=Network(74eabb6e-443b-4974-812e-bbcfac0f1a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd723fa4-bf')
Jul 31 13:02:57 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] calling os-brick to detach iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06687dda80>, {'target_iqns': ['iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGNRWUMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 13:02:57 user nova-compute[72447]: WARNING os_brick.initiator.connectors.base [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 13:02:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b', 0)] {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[111d9e25-3610-47c3-998d-e2e1cc5cf380]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[654faa3e-ecdc-466f-ab0e-5c2ab430d691]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 13:02:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b (non-flash)
Jul 31 13:02:57 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0668675c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b'): ({'sdb'}, set())}) {{(pid=72447) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Removing single pathed devices sdb {{(pid=72447) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5df7c3e-6169-42e2-891b-caa991919bc7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:02:57 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f127af-eb13-4394-851e-92df142c1c23]: (4, ('ok\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Flushing IO for device /dev/sdb {{(pid=72447) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43ac5ca-73cb-4be6-b12b-e71ca6900573]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72447) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ec9de8-1676-4089-a19a-edd139590f61]: (4, ('1', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG os_brick.initiator.linuxscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] SCSI volumes sdb have been removed. {{(pid=72447) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc035d2ed-d53c9b2d3b00d1b6', '/dev/disk/by-id/scsi-26435336339623264', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c035d2ed') {{(pid=83492) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e8c70d-aac9-4551-9fe2-6706ba66722a]: (4, None) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b')] {{(pid=72447) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2db748b-fd46-42ca-9df4-ccb49ec131ef]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --logout {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcce4310-269b-4dd1-9300-8f41b72ae370]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260]
Jul 31 13:02:58 user nova-compute[72447]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b, portal: 172.16.0.220,3260] successful.
Jul 31 13:02:58 user nova-compute[72447]:  stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op delete {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cf55ba-95f1-4a5d-bf24-65c7e5a69a2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83492) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6686cbd-043f-4baa-afb2-49f664cb0eed]: (4, ('', '')) {{(pid=83492) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72447) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.base [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] <== disconnect_volume: return (283ms) None {{(pid=72447) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Disconnected iSCSI Volume {{(pid=72447) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 13:02:58 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Deleting instance files /opt/stack/data/nova/instances/60be5c68-fbad-4bb0-a9f8-121d8e211dd8_del
Jul 31 13:02:58 user nova-compute[72447]: INFO nova.virt.libvirt.driver [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Deletion of /opt/stack/data/nova/instances/60be5c68-fbad-4bb0-a9f8-121d8e211dd8_del complete
Jul 31 13:02:58 user nova-compute[72447]: INFO nova.compute.manager [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Took 1.11 seconds to destroy the instance on the hypervisor.
Jul 31 13:02:58 user nova-compute[72447]: DEBUG oslo.service.loopingcall [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72447) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG nova.compute.manager [-] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Deallocating network for instance {{(pid=72447) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] deallocate_for_instance() {{(pid=72447) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 13:02:58 user nova-compute[72447]: DEBUG nova.network.neutron [-] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Updating instance_info_cache with network_info: [] {{(pid=72447) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 13:02:58 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Took 0.51 seconds to deallocate network for instance.
Jul 31 13:02:58 user nova-compute[72447]: DEBUG nova.compute.manager [req-c5525bef-cf0c-4220-b89b-3be19a7c9f11 req-02ded39f-87ab-48ad-b127-f9389a5de91f service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Received event network-vif-deleted-dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-954ee620-3c8a-416e-a58c-c5af3676ea5b req-ea02dde7-3c08-4687-a78c-d92b556f106e service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Received event network-vif-unplugged-dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-954ee620-3c8a-416e-a58c-c5af3676ea5b req-ea02dde7-3c08-4687-a78c-d92b556f106e service nova] Acquiring lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-954ee620-3c8a-416e-a58c-c5af3676ea5b req-ea02dde7-3c08-4687-a78c-d92b556f106e service nova] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-954ee620-3c8a-416e-a58c-c5af3676ea5b req-ea02dde7-3c08-4687-a78c-d92b556f106e service nova] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-954ee620-3c8a-416e-a58c-c5af3676ea5b req-ea02dde7-3c08-4687-a78c-d92b556f106e service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] No waiting events found dispatching network-vif-unplugged-dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-954ee620-3c8a-416e-a58c-c5af3676ea5b req-ea02dde7-3c08-4687-a78c-d92b556f106e service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Received event network-vif-unplugged-dd723fa4-bf32-4d63-a4cb-d65bb4064710 for instance with task_state deleting. {{(pid=72447) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-954ee620-3c8a-416e-a58c-c5af3676ea5b req-ea02dde7-3c08-4687-a78c-d92b556f106e service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Received event network-vif-plugged-dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-954ee620-3c8a-416e-a58c-c5af3676ea5b req-ea02dde7-3c08-4687-a78c-d92b556f106e service nova] Acquiring lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-954ee620-3c8a-416e-a58c-c5af3676ea5b req-ea02dde7-3c08-4687-a78c-d92b556f106e service nova] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [req-954ee620-3c8a-416e-a58c-c5af3676ea5b req-ea02dde7-3c08-4687-a78c-d92b556f106e service nova] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG nova.compute.manager [req-954ee620-3c8a-416e-a58c-c5af3676ea5b req-ea02dde7-3c08-4687-a78c-d92b556f106e service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] No waiting events found dispatching network-vif-plugged-dd723fa4-bf32-4d63-a4cb-d65bb4064710 {{(pid=72447) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 13:02:59 user nova-compute[72447]: WARNING nova.compute.manager [req-954ee620-3c8a-416e-a58c-c5af3676ea5b req-ea02dde7-3c08-4687-a78c-d92b556f106e service nova] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Received unexpected event network-vif-plugged-dd723fa4-bf32-4d63-a4cb-d65bb4064710 for instance with vm_state active and task_state deleting.
Jul 31 13:02:59 user nova-compute[72447]: INFO nova.compute.manager [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Took 0.76 seconds to detach 1 volumes for instance.
Jul 31 13:02:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 13:02:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:02:59 user nova-compute[72447]: INFO nova.scheduler.client.report [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Deleted allocations for instance 60be5c68-fbad-4bb0-a9f8-121d8e211dd8
Jul 31 13:02:59 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-b0c1038d-c447-4dea-b30e-33406deaabf7 tempest-TestVolumeBootPattern-37536115 tempest-TestVolumeBootPattern-37536115-project-member] Lock "60be5c68-fbad-4bb0-a9f8-121d8e211dd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.669s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:03:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:03:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:03:12 user nova-compute[72447]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690808577.8710048, 60be5c68-fbad-4bb0-a9f8-121d8e211dd8 => Stopped> {{(pid=72447) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 13:03:12 user nova-compute[72447]: INFO nova.compute.manager [-] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] VM Stopped (Lifecycle Event)
Jul 31 13:03:12 user nova-compute[72447]: DEBUG nova.compute.manager [None req-68b1447a-aee5-4491-8845-5e26dae0d941 None None] [instance: 60be5c68-fbad-4bb0-a9f8-121d8e211dd8] Checking state {{(pid=72447) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 13:03:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:03:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:03:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 13:03:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:03:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:03:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:03:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:03:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:03:24 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:03:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 13:03:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 13:03:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 13:03:27 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:03:29 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:03:32 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:03:32 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72447) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 13:03:32 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:03:34 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72447) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 13:03:35 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 13:03:35 user nova-compute[72447]: WARNING nova.virt.libvirt.driver [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 13:03:35 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=25.12946319580078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72447) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72447) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing inventories for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating ProviderTree inventory for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Updating inventory in ProviderTree for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing aggregate associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, aggregates: None {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Refreshing trait associations for resource provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO {{(pid=72447) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG nova.compute.provider_tree [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed in ProviderTree for provider: b4624c66-2a39-4376-bf09-7f8bf9b99fc6 {{(pid=72447) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG nova.scheduler.client.report [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Inventory has not changed for provider b4624c66-2a39-4376-bf09-7f8bf9b99fc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72447) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG nova.compute.resource_tracker [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Compute_service record updated for user:user {{(pid=72447) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 13:03:35 user nova-compute[72447]: DEBUG oslo_concurrency.lockutils [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=72447) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 13:03:36 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:03:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:03:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:03:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 13:03:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:03:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:03:37 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:03:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:03:39 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:03:42 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:03:42 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:03:47 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:03:47 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:03:48 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:03:52 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:03:56 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:03:57 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:03:59 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:04:02 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:04:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:04:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:04:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 13:04:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:04:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:04:07 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:04:12 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:04:17 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:04:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 13:04:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:04:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72447) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 13:04:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:04:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72447) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 13:04:22 user nova-compute[72447]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72447) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 13:04:24 user nova-compute[72447]: DEBUG oslo_service.periodic_task [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72447) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 13:04:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Starting heal instance info cache {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 13:04:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Rebuilding the list of instances to heal {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 13:04:24 user nova-compute[72447]: DEBUG nova.compute.manager [None req-3215a354-38eb-4f11-bb2c-022b1046cba6 None None] Didn't find any instances for network info cache update. {{(pid=72447) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}